-- Logs begin at Fri 2022-07-15 20:01:24 UTC, end at Fri 2022-07-15 21:03:13 UTC. -- Jul 15 20:36:06.868084 dv-osbrick-836059-7-ceph systemd[1]: Starting Devstack devstack@keystone.service... Jul 15 20:36:06.877409 dv-osbrick-836059-7-ceph devstack@keystone.service[98941]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 15 20:36:06.879383 dv-osbrick-836059-7-ceph devstack@keystone.service[98941]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jul 15 20:36:06 2022] *** Jul 15 20:36:06.879383 dv-osbrick-836059-7-ceph devstack@keystone.service[98941]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 15 20:36:06.879383 dv-osbrick-836059-7-ceph devstack@keystone.service[98941]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 15 20:36:06.879383 dv-osbrick-836059-7-ceph devstack@keystone.service[98941]: nodename: dv-osbrick-836059-7-ceph Jul 15 20:36:06.879383 dv-osbrick-836059-7-ceph devstack@keystone.service[98941]: machine: x86_64 Jul 15 20:36:06.879383 dv-osbrick-836059-7-ceph devstack@keystone.service[98941]: clock source: unix Jul 15 20:36:06.879383 dv-osbrick-836059-7-ceph devstack@keystone.service[98941]: pcre jit disabled Jul 15 20:36:06.879383 dv-osbrick-836059-7-ceph devstack@keystone.service[98941]: detected number of CPU cores: 4 Jul 15 20:36:06.879383 dv-osbrick-836059-7-ceph devstack@keystone.service[98941]: current working directory: / Jul 15 20:36:06.879383 dv-osbrick-836059-7-ceph devstack@keystone.service[98941]: detected binary path: /usr/bin/uwsgi-core Jul 15 20:36:06.879383 dv-osbrick-836059-7-ceph devstack@keystone.service[98941]: your processes number limit is 47680 Jul 15 20:36:06.879383 dv-osbrick-836059-7-ceph devstack@keystone.service[98941]: your memory page size is 4096 bytes Jul 15 20:36:06.879383 dv-osbrick-836059-7-ceph devstack@keystone.service[98941]: detected max file descriptor number: 2048 Jul 15 20:36:06.880026 dv-osbrick-836059-7-ceph devstack@keystone.service[98941]: lock engine: pthread robust mutexes Jul 15 20:36:06.880026 dv-osbrick-836059-7-ceph devstack@keystone.service[98941]: thunder lock: enabled Jul 15 20:36:06.880026 dv-osbrick-836059-7-ceph devstack@keystone.service[98941]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 15 20:36:06.880026 dv-osbrick-836059-7-ceph devstack@keystone.service[98941]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 15 20:36:06.923886 dv-osbrick-836059-7-ceph devstack@keystone.service[98941]: Python main interpreter initialized at 0x5565696179c0 Jul 15 20:36:06.923886 dv-osbrick-836059-7-ceph devstack@keystone.service[98941]: python threads support enabled Jul 15 20:36:06.923886 dv-osbrick-836059-7-ceph devstack@keystone.service[98941]: your server socket listen backlog is limited to 100 connections Jul 15 20:36:06.923886 dv-osbrick-836059-7-ceph devstack@keystone.service[98941]: your mercy for graceful operations on workers is 90 seconds Jul 15 20:36:06.924227 dv-osbrick-836059-7-ceph devstack@keystone.service[98941]: mapped 403077 bytes (393 KB) for 2 cores Jul 15 20:36:06.924300 dv-osbrick-836059-7-ceph devstack@keystone.service[98941]: *** Operational MODE: preforking *** Jul 15 20:36:06.924543 dv-osbrick-836059-7-ceph devstack@keystone.service[98941]: *** uWSGI is running in multiple interpreter mode *** Jul 15 20:36:06.924543 dv-osbrick-836059-7-ceph devstack@keystone.service[98941]: spawned uWSGI master process (pid: 98941) Jul 15 20:36:06.924733 dv-osbrick-836059-7-ceph systemd[1]: Started Devstack devstack@keystone.service. Jul 15 20:36:06.926790 dv-osbrick-836059-7-ceph devstack@keystone.service[98941]: spawned uWSGI worker 1 (pid: 98951, cores: 1) Jul 15 20:36:06.926790 dv-osbrick-836059-7-ceph devstack@keystone.service[98941]: spawned uWSGI worker 2 (pid: 98952, cores: 1) Jul 15 20:36:06.926790 dv-osbrick-836059-7-ceph devstack@keystone.service[98941]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 15 20:36:12.591809 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 15 20:36:12.591809 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: from cryptography.utils import int_from_bytes Jul 15 20:36:12.592577 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 15 20:36:12.592577 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: from cryptography.utils import int_from_bytes Jul 15 20:36:12.593265 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 15 20:36:12.593265 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: from cryptography.utils import int_from_bytes Jul 15 20:36:12.593725 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 15 20:36:12.593725 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: from cryptography.utils import int_from_bytes Jul 15 20:36:12.639909 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 15 20:36:12.640098 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 15 20:36:12.640290 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] command line args: [] {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 15 20:36:12.640559 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 15 20:36:12.640738 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] ================================================================================ {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 15 20:36:12.640955 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 15 20:36:12.641034 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] admin_token = **** {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.641152 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 15 20:36:12.641230 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] config_dir = [] {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.641347 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] command line args: [] {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 15 20:36:12.641423 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.641564 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] config_source = [] {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.642170 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 15 20:36:12.642351 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] ================================================================================ {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 15 20:36:12.642434 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] debug = True {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.642564 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.642926 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] admin_token = **** {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.642926 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] config_dir = [] {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.643122 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.643215 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.643313 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] config_source = [] {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.643414 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] insecure_debug = False {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.643517 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] debug = True {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.643616 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.643709 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.643844 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.643947 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.644040 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] list_limit = None {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.644131 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] insecure_debug = False {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.644234 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] log_config_append = None {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.644234 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.644498 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.644675 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] log_dir = None {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.644778 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.644881 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] log_file = None {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.644970 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] list_limit = None {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.645078 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.645160 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] log_config_append = None {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.645238 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.645308 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.645308 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] log_dir = None {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.645488 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.645601 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] log_file = None {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.645679 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.645759 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.645872 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.645872 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.646060 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.646213 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.646285 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.646367 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.646446 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.646518 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.646779 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.646866 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.646945 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.647062 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.647141 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.647210 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.647283 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.647394 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.647479 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.647580 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.647662 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] notification_format = cadf {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.647808 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.647930 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.648038 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.648291 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.648378 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.648537 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] notification_format = cadf {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.648619 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] publish_errors = False {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.648768 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.648845 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.648999 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.649178 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.649292 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.649413 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.649528 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] publish_errors = False {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.649640 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.649726 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.649867 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] standard_threads = False {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.649966 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.650096 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.650185 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] strict_password_check = False {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.650347 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.650430 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.650549 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] use_eventlog = False {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.650622 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.650691 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] use_journal = False {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.650805 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] standard_threads = False {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.650882 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] use_json = False {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.651012 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] use_stderr = False {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.651098 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] strict_password_check = False {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.651189 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] use_syslog = False {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.651270 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.651418 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] watch_log_file = False {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.651499 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] use_eventlog = False {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.651600 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] use_journal = False {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.651729 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.651843 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] use_json = False {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.651938 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.652029 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] use_stderr = False {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.652120 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] use_syslog = False {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.652222 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.652346 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] watch_log_file = False {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:36:12.652444 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.652575 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.652677 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.652816 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.652944 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.653057 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.653172 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.653284 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.653404 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.653515 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.653632 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.653745 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.653856 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.653971 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.654106 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.654220 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.654350 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.654464 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.654575 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.654691 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.654803 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.654914 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.655067 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.655188 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.655311 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.655423 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.655534 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.655644 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.655830 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.655946 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.656063 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.656181 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.656292 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.656398 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.656516 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.656633 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.656744 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.656854 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.656964 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.657080 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.657199 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.657361 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.657999 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.658130 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.658235 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.658345 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.658462 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.658575 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.658685 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.658795 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.658904 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.659014 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.659132 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.659250 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.659361 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.659471 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.659580 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.659698 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.659809 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.659919 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.660035 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.660180 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.660293 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.660412 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.660529 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.660640 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.660750 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.660859 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.660969 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.661089 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.661202 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.661318 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.661429 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.661575 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.661695 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.661876 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.661995 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.662125 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.662239 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.662349 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.662458 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.662580 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.662692 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.662803 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.662913 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.663022 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.663132 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.663249 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.663427 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.663541 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.663657 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.663774 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.663886 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.664004 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.664115 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.664226 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.664340 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.664449 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.664559 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.664688 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.664805 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.664917 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.665033 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.665145 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.665285 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.665410 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.665523 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.665634 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.665750 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.665862 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.665973 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.666176 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.666292 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.666402 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.666515 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.666625 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.666736 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.666860 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.666994 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.667108 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.667229 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.667342 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.667454 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.667565 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.667687 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.667806 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.667918 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.668037 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.668149 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.668261 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.668378 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.668498 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.668611 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.668722 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.668832 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.668944 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.669054 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.669172 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.669285 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.669396 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.669512 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.669615 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.669730 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.669850 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] cache.enabled = True {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.669968 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.670140 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.670283 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.670427 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.670555 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.670671 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.670782 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.670893 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.671004 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] cache.enabled = True {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.671115 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.671233 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.671351 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.671463 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.671574 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.671687 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.671797 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.671916 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.672034 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.672152 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.672270 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.672382 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.672493 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.672612 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.672726 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.672837 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.673552 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.673674 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.673789 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.673789 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.674131 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.674131 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.674343 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.674454 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.674566 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.674566 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.674802 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.674928 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.675041 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.675159 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.675272 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.675384 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.675495 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.675614 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.675727 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.675838 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.675950 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.676062 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.676179 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.676299 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.676412 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.676412 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.676620 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.676732 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.676855 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.676977 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.677090 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.677201 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.677313 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] auth.external = None {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.677424 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.677541 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] auth.mapped = None {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.677661 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.677774 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.677886 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.677999 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.678152 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.678278 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] auth.password = None {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.678278 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] auth.token = None {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.678526 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] auth.external = None {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.678526 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] auth.mapped = None {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.678748 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.678748 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] catalog.caching = True {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.678957 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.679071 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.679194 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.679307 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.679419 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] auth.password = None {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.679539 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.679652 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] auth.token = None {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.679764 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.679883 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.680003 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.680117 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] catalog.caching = True {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.680230 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] credential.caching = True {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.680341 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.680452 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] credential.driver = sql {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.680571 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.680685 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.680797 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.680910 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.681022 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.681135 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.681255 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.681368 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.681479 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] credential.caching = True {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.681591 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.681710 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] credential.driver = sql {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.681823 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.681943 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.682057 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.682185 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.682298 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.682410 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.682521 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.682648 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.682648 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.682861 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.682973 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.683091 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.683205 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.683325 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.683438 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.683549 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.683661 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.683773 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.683773 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] federation.caching = True {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.683990 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.684105 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.684217 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.684330 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] federation.driver = sql {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.684442 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.684562 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.684682 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.684799 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.684911 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.685021 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.685132 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] federation.caching = True {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.685248 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.685369 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.685482 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.685890 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] federation.driver = sql {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.686010 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.686148 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.686262 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.686389 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.686504 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.686616 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.686729 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.686847 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.686961 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] identity.caching = True {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.687082 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.687196 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.687308 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.687422 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.687534 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.687646 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.687828 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.687944 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.688056 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.688168 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] identity.driver = sql {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.688280 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] identity.caching = True {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.688391 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.688548 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.688676 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.688866 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.688983 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.689103 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.689227 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.689341 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.689454 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.689568 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] identity.driver = sql {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.689682 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.689800 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.689926 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.690041 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.690168 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.690281 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.690393 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.690506 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.690631 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.690745 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.690858 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.690970 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.691081 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.691193 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.691313 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.691434 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.691547 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.691661 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.691773 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.691891 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.692013 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.692127 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.692240 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.692352 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.692464 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.692575 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.692765 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.692882 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.692995 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.693113 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.693227 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.693339 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.693459 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.693572 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.693687 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.693799 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.693910 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.694023 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.694439 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.694557 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.694670 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.694786 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.694898 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.695010 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.695130 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.695243 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.695361 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.695481 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.695594 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.695707 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.695827 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] ldap.password = **** {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.695940 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.696059 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.696172 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.696284 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.696395 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.696515 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.696635 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.696748 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.696861 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.696973 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.697093 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] ldap.password = **** {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.697214 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.697327 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.697440 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.697552 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.697664 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.697776 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.697897 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.698010 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.698136 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.698251 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.698364 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.698475 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.698599 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.698712 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.698824 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.698937 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.699049 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.699161 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.699280 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] ldap.user = None {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.699394 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.699506 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.699619 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.699731 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.699843 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.699963 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.700077 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.700189 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.700301 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.700413 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.700525 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] ldap.user = None {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.700645 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.700759 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.700871 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.700983 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.701096 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.701216 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.701330 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.701442 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.701554 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.701666 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.701779 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.701898 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.702012 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.702172 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.702288 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.702400 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.702512 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.702635 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.702750 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.702862 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.702974 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.703086 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.703199 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.703319 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.703433 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.703545 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.703657 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.703768 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.703880 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.704000 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.704113 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.704113 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.704811 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.704924 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.705035 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.705155 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.705270 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.705382 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.705493 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.705605 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.705717 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.705717 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.705935 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] policy.driver = sql {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.705935 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.706157 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.706157 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.706369 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.706369 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.706599 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.706713 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] receipt.caching = True {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.706824 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.706936 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.707048 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.707168 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.707282 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] policy.driver = sql {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.707395 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.707507 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.707619 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.707731 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.707851 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.707965 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.708076 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] resource.caching = True {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.708188 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] receipt.caching = True {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.708300 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.708413 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.708533 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] resource.driver = sql {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.708646 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.708759 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.708871 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.708983 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.709096 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.709220 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.709334 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.709448 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] revoke.caching = True {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.709566 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] resource.caching = True {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.709681 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.709794 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.709914 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.710028 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] resource.driver = sql {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.710158 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] role.cache_time = None {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.710270 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.710383 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] role.caching = True {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.710495 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.710686 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] role.driver = sql {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.710803 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.710921 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] role.list_limit = None {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.711034 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] revoke.caching = True {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.711146 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.711258 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.711378 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.711493 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.711606 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.711718 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] role.cache_time = None {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.711830 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.711942 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] role.caching = True {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.712062 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.712176 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] role.driver = sql {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.712288 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.712399 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] role.list_limit = None {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.712511 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.712624 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.712744 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.712858 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.712970 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.713082 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.713194 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.713314 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.713477 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.713596 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.713709 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.713821 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.713933 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.714053 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.714053 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.714283 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.714396 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.714508 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.714622 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.714748 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.714862 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.714975 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.715087 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.715200 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.715312 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.715432 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.715432 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.715644 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.715763 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.715876 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.715988 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.716109 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.716223 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.716335 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.716447 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.716789 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.716910 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.717031 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.717146 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.717258 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.717370 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.717481 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.717868 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.717997 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.718137 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.718252 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.718364 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.718477 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.718589 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.718704 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.718817 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] token.cache_time = None {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.718930 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.719041 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] token.caching = True {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.719153 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.719273 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.719386 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.719499 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] token.provider = fernet {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.719611 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.719723 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.719868 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.720483 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.720598 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.720710 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.720823 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] token.cache_time = None {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.720935 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.721047 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] token.caching = True {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.721168 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.721282 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.721395 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.721507 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] token.provider = fernet {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.721619 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] trust.driver = sql {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.721730 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.721851 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.721965 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.722094 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.722094 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.722309 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.722309 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.722530 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.722645 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.722758 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.722869 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.722981 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.723093 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] trust.driver = sql {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.723213 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.723327 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.723439 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.723551 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.723662 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] database.connection = **** {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.723782 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.723904 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.724018 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.724140 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.724253 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.724365 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.724476 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.724837 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.724954 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.725076 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.725198 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.725311 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.725311 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.725530 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] database.connection = **** {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.725659 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.725783 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.725905 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.726019 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.726183 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.726335 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.726458 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.726572 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.726692 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.726807 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.726920 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.727032 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.727144 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.727257 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.727380 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.727494 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.727607 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.727719 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.727831 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.727943 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.728062 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.728176 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.728290 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=98951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 15 20:36:12.728402 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.728402 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.728402 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.728402 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.728402 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.728402 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.728402 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:36:12.728402 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=98952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 15 20:36:12.758214 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=98951) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:36:12.758437 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=98951) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:36:12.758647 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=98951) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:36:12.763643 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=98952) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:36:12.763879 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=98952) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:36:12.764111 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=98952) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:36:12.769414 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=98951) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:36:12.776089 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=98952) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:36:12.798418 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=98951) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:36:12.798647 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=98951) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:36:12.802363 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=98952) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:36:12.802601 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=98952) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:36:12.851586 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=98951) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:36:12.852018 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=98952) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:36:12.901780 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=98951) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:36:12.902007 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=98951) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:36:12.902436 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=98952) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:36:12.902674 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=98952) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:36:12.966477 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=98951) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:36:12.966705 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=98951) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:36:12.966922 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=98952) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:36:12.967009 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=98951) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:36:12.967141 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=98951) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:36:12.967225 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=98952) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:36:12.967359 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=98951) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:36:12.967443 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=98952) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:36:12.967575 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=98951) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:36:12.967668 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=98952) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:36:12.967793 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=98952) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:36:12.968012 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=98952) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:36:12.990915 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=98951) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:36:12.991150 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=98952) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:36:12.991276 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=98951) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:36:12.991359 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=98951) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:36:12.991432 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=98952) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:36:12.991535 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=98951) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:36:12.991620 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=98952) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:36:12.991756 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=98951) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:36:12.991841 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=98952) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:36:12.991971 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=98951) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:36:12.992054 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=98952) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:36:12.992187 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=98951) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:36:12.992271 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=98952) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:36:12.992406 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=98952) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:36:13.005453 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=98951) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:36:13.005763 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=98952) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:36:13.017907 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=98951) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:36:13.018158 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=98951) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:36:13.018345 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=98952) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:36:13.018440 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=98951) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:36:13.018582 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=98952) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:36:13.018666 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=98951) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:36:13.018797 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=98951) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:36:13.018888 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=98952) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:36:13.019011 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=98951) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:36:13.019095 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=98952) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:36:13.019225 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=98951) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:36:13.019309 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=98952) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:36:13.019439 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=98952) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:36:13.019824 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=98952) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:36:13.036937 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=98951) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.037123 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=98952) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.037209 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=98951) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 15 20:36:13.037337 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=98952) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 15 20:36:13.037467 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=98951) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.037669 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=98951) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 15 20:36:13.037752 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=98952) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.037870 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=98952) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 15 20:36:13.037951 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=98951) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.038170 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=98952) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.038269 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=98951) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.038438 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=98952) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.038521 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=98951) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.038698 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=98951) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.038788 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=98952) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.038955 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=98952) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.050239 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=98951) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.050475 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=98952) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.050560 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=98951) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.050752 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=98952) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.050836 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=98951) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.051023 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=98952) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.051111 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=98951) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.051306 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=98952) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.059240 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=98951) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 20:36:13.062692 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=98951) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 20:36:13.062969 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=98951) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.063249 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=98951) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.065037 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=98951) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.065037 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=98951) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.065037 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=98951) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.065372 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=98952) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 20:36:13.065456 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=98951) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.065456 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=98951) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.065456 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=98951) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.065456 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=98951) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.065708 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=98951) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.068417 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=98952) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 20:36:13.068702 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=98952) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.068986 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=98952) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.069523 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=98952) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.069904 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=98952) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.070218 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=98952) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.070663 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=98952) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.070959 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=98952) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.071251 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=98952) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.071544 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=98952) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.071828 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=98952) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.094408 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=98951) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.096642 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=98951) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 20:36:13.096933 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=98951) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.098652 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=98952) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.100395 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=98952) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 20:36:13.100782 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=98952) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.102224 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=98951) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 20:36:13.102503 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=98951) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.102780 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=98951) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.105936 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=98952) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 20:36:13.106244 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=98952) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.106533 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=98952) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.109961 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=98951) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 20:36:13.110263 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=98951) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.114421 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=98952) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 20:36:13.114708 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=98952) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.115336 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=98951) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 20:36:13.115736 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=98951) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.116018 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=98951) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.116298 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=98951) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.116567 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=98951) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.116835 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=98951) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.117103 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=98951) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.117375 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=98951) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.119209 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=98952) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 20:36:13.119625 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=98952) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.119915 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=98952) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.120203 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=98952) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.120482 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=98952) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.120807 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=98952) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.121020 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=98952) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.121294 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=98952) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.135951 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=98951) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.136225 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=98951) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.140847 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=98951) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 20:36:13.142465 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=98952) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.142749 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=98952) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.144534 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=98951) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.144823 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=98951) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.147417 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=98952) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 20:36:13.149803 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=98951) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 20:36:13.151109 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=98952) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.151410 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=98952) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.153374 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=98951) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 20:36:13.156418 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=98952) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 20:36:13.157133 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=98951) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.157960 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=98951) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.158269 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=98951) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.158548 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=98951) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.158819 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=98951) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.159102 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=98951) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.160594 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=98952) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 20:36:13.164381 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=98952) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.164685 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=98952) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.164977 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=98952) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.165270 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=98952) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.165555 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=98952) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.165845 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=98952) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.178904 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=98951) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 20:36:13.179191 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=98951) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.179461 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=98951) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.179720 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=98951) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.185357 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=98952) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 20:36:13.185660 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=98952) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.185933 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=98952) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.186222 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=98952) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.187594 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=98951) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.189325 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=98951) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.189597 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=98951) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.192606 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=98951) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 20:36:13.192882 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=98951) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.193165 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=98951) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.193465 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=98951) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.193733 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=98951) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.194448 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=98952) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.196179 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=98952) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.196459 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=98952) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.199525 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=98952) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 20:36:13.199809 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=98952) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.200227 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=98952) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.200386 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=98952) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.200676 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=98952) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.207234 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=98951) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 20:36:13.207515 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=98951) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.207791 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=98951) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.208068 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=98951) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.208344 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=98951) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.208614 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=98951) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.208899 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=98951) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.214021 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=98952) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 20:36:13.214329 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=98952) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.214613 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=98952) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.214896 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=98952) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.215178 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=98952) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.215457 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=98952) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.215746 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=98952) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.227338 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=98951) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 20:36:13.230591 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=98951) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 20:36:13.233852 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=98951) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.234396 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=98952) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 20:36:13.235512 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=98951) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.237114 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=98951) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 20:36:13.237389 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=98951) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.237663 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=98951) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.237744 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=98952) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 20:36:13.241054 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=98952) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.242626 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=98952) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.244262 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=98952) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 20:36:13.244543 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=98952) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.244824 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=98952) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.244982 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=98951) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.246598 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=98951) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 20:36:13.249857 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=98951) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.250169 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=98951) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.250450 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=98951) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.250722 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=98951) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.252797 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=98952) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.254437 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=98952) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 20:36:13.257635 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=98952) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.257927 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=98952) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.258242 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=98952) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.258524 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=98952) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.260327 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=98951) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 20:36:13.260612 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=98951) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.261937 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=98951) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.267662 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=98952) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 20:36:13.267952 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=98952) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.269300 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=98952) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.269910 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=98951) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 20:36:13.270214 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=98951) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.270495 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=98951) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.270768 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=98951) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.271044 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=98951) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.271311 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=98951) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.271586 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=98951) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.271849 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=98951) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.272112 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=98951) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.272383 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=98951) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.272660 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=98951) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.272923 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=98951) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.273180 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=98951) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.273443 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=98951) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.277328 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=98952) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 20:36:13.277610 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=98952) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.277900 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=98952) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.278205 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=98952) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.278484 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=98952) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.278761 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=98952) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.279046 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=98952) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.279323 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=98952) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.279597 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=98952) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.279876 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=98952) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.280166 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=98952) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.280439 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=98952) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.280716 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=98952) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.280990 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=98952) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:36:13.311397 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5565696179c0 pid: 98951 (default app) Jul 15 20:36:13.315325 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85bd633-81a6-4a9a-8559-3ce39c21ab44 None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:13.315621 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85bd633-81a6-4a9a-8559-3ce39c21ab44 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:13.315899 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85bd633-81a6-4a9a-8559-3ce39c21ab44 None None] PATH_INFO: `/v3` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:13.319934 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5565696179c0 pid: 98952 (default app) Jul 15 20:36:13.320417 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 791 bytes} [Fri Jul 15 20:36:13 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:36:21.332788 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5585dda8-75e1-453b-83d3-d751ad203757 None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:21.333352 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5585dda8-75e1-453b-83d3-d751ad203757 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:21.333352 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5585dda8-75e1-453b-83d3-d751ad203757 None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:21.337742 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 1/2] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:36:21 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:36:21.343238 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb546ee-9577-4127-94eb-a27b178c0d23 None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:21.343621 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb546ee-9577-4127-94eb-a27b178c0d23 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:21.343800 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb546ee-9577-4127-94eb-a27b178c0d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:21.417162 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: INFO dbcounter [None req-3cb546ee-9577-4127-94eb-a27b178c0d23 None None] Registered counter for database keystone Jul 15 20:36:21.437829 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG oslo_db.sqlalchemy.engines [None req-3cb546ee-9577-4127-94eb-a27b178c0d23 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=98951) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 20:36:21.444751 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writer thread running {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 20:36:21.622320 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG passlib.handlers.bcrypt [None req-3cb546ee-9577-4127-94eb-a27b178c0d23 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=98951) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 15 20:36:21.622673 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG passlib.handlers.bcrypt [None req-3cb546ee-9577-4127-94eb-a27b178c0d23 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=98951) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 15 20:36:21.678376 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-3cb546ee-9577-4127-94eb-a27b178c0d23 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:21.679992 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-3cb546ee-9577-4127-94eb-a27b178c0d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:21.800716 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 2/3] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:36:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 459 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 15 20:36:21.978916 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5585dda8-75e1-453b-83d3-d751ad203757 None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:22.054403 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: INFO dbcounter [None req-5585dda8-75e1-453b-83d3-d751ad203757 None None] Registered counter for database keystone Jul 15 20:36:22.073203 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG oslo_db.sqlalchemy.engines [None req-5585dda8-75e1-453b-83d3-d751ad203757 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=98952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 20:36:22.079422 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writer thread running {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 20:36:22.197876 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5585dda8-75e1-453b-83d3-d751ad203757 None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:22.202156 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8666c43-5f66-49f4-9f6e-1c54b9ab653e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5e0cb75b5f34491a7e94518c7bcdb03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:22.202813 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8666c43-5f66-49f4-9f6e-1c54b9ab653e admin admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:22.203101 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8666c43-5f66-49f4-9f6e-1c54b9ab653e admin admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:22.203380 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8666c43-5f66-49f4-9f6e-1c54b9ab653e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:22.211507 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8666c43-5f66-49f4-9f6e-1c54b9ab653e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:22.263130 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b8666c43-5f66-49f4-9f6e-1c54b9ab653e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 15 20:36:22.263421 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8666c43-5f66-49f4-9f6e-1c54b9ab653e admin admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:22.273273 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 2/4] 10.222.0.16 () {58 vars in 1324 bytes} [Fri Jul 15 20:36:21 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 15 20:36:22.279368 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb546ee-9577-4127-94eb-a27b178c0d23 None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:22.294335 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb546ee-9577-4127-94eb-a27b178c0d23 None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:22.299483 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e88633-830a-4f54-8349-96926a38e903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5e0cb75b5f34491a7e94518c7bcdb03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:22.300610 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e88633-830a-4f54-8349-96926a38e903 admin admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:22.300898 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e88633-830a-4f54-8349-96926a38e903 admin admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:22.301175 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e88633-830a-4f54-8349-96926a38e903 admin admin] PATH_INFO: `/v3/projects/c5e0cb75b5f34491a7e94518c7bcdb03` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:22.302709 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e88633-830a-4f54-8349-96926a38e903 admin admin] RBAC: Authorizing `identity:get_project(project_id=c5e0cb75b5f34491a7e94518c7bcdb03)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:22.355230 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b8e88633-830a-4f54-8349-96926a38e903 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 15 20:36:22.355794 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e88633-830a-4f54-8349-96926a38e903 admin admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:22.360165 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 3/5] 10.222.0.16 () {56 vars in 1207 bytes} [Fri Jul 15 20:36:22 2022] GET /identity/v3/projects/c5e0cb75b5f34491a7e94518c7bcdb03 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:36:24.550349 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0fbc0-7ffe-4d3e-9cbd-683df2839342 None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:24.550824 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0fbc0-7ffe-4d3e-9cbd-683df2839342 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:24.550910 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0fbc0-7ffe-4d3e-9cbd-683df2839342 None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:24.555005 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 3/6] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:36:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 20:36:24.560303 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e55cf9-3c43-4fa9-8010-fabd31dbb1fd None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:24.560662 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e55cf9-3c43-4fa9-8010-fabd31dbb1fd None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:24.560899 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e55cf9-3c43-4fa9-8010-fabd31dbb1fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:24.580815 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-20e55cf9-3c43-4fa9-8010-fabd31dbb1fd None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:24.586170 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-20e55cf9-3c43-4fa9-8010-fabd31dbb1fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:24.593321 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 4/7] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:36:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 15 20:36:24.616953 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b0fbc0-7ffe-4d3e-9cbd-683df2839342 None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:24.629529 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b0fbc0-7ffe-4d3e-9cbd-683df2839342 None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:24.633713 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae15694d-00e2-4650-894a-fdedd03f3341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5e0cb75b5f34491a7e94518c7bcdb03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:24.634399 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae15694d-00e2-4650-894a-fdedd03f3341 admin admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:24.634689 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae15694d-00e2-4650-894a-fdedd03f3341 admin admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:24.634974 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae15694d-00e2-4650-894a-fdedd03f3341 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:24.642675 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae15694d-00e2-4650-894a-fdedd03f3341 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:24.644456 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae15694d-00e2-4650-894a-fdedd03f3341 admin admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:24.653122 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 4/8] 10.222.0.16 () {58 vars in 1324 bytes} [Fri Jul 15 20:36:24 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 15 20:36:24.658247 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e55cf9-3c43-4fa9-8010-fabd31dbb1fd None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:24.667135 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e55cf9-3c43-4fa9-8010-fabd31dbb1fd None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:24.671422 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5a2f59-5a10-43bc-a413-91f4355f5798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5e0cb75b5f34491a7e94518c7bcdb03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:24.672267 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5a2f59-5a10-43bc-a413-91f4355f5798 admin admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:24.672553 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5a2f59-5a10-43bc-a413-91f4355f5798 admin admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:24.673417 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5a2f59-5a10-43bc-a413-91f4355f5798 admin admin] PATH_INFO: `/v3/users/904f3e39010c4ee1ad10cdd271b0b153` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:24.674821 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5a2f59-5a10-43bc-a413-91f4355f5798 admin admin] RBAC: Authorizing `identity:get_user(user_id=904f3e39010c4ee1ad10cdd271b0b153)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:24.676638 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5a2f59-5a10-43bc-a413-91f4355f5798 admin admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:24.678179 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 5/9] 10.222.0.16 () {56 vars in 1198 bytes} [Fri Jul 15 20:36:24 2022] GET /identity/v3/users/904f3e39010c4ee1ad10cdd271b0b153 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:36:26.953551 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6200a5-aef6-47a0-9b14-e803ce5f79db None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:26.954604 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6200a5-aef6-47a0-9b14-e803ce5f79db None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:26.954744 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6200a5-aef6-47a0-9b14-e803ce5f79db None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:26.956090 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 5/10] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:36:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:36:26.961128 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd91a6a-46ec-4e42-82c4-349b792cedd7 None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:26.961507 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd91a6a-46ec-4e42-82c4-349b792cedd7 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:26.961699 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd91a6a-46ec-4e42-82c4-349b792cedd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:26.978781 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-ecd91a6a-46ec-4e42-82c4-349b792cedd7 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:26.979988 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-ecd91a6a-46ec-4e42-82c4-349b792cedd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:27.018978 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046cc7bc-fcee-4a2d-9b0c-437936b1b9c7 None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:27.019272 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046cc7bc-fcee-4a2d-9b0c-437936b1b9c7 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:27.019558 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046cc7bc-fcee-4a2d-9b0c-437936b1b9c7 None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:27.020888 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 6/11] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:36:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 20:36:27.026198 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfcc320-eda7-4a08-b0a4-52f24901c8d6 None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:27.026498 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfcc320-eda7-4a08-b0a4-52f24901c8d6 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:27.026787 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfcc320-eda7-4a08-b0a4-52f24901c8d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:27.061256 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 6/12] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:36:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:36:27.071322 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG passlib.handlers.bcrypt [None req-8bfcc320-eda7-4a08-b0a4-52f24901c8d6 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=98952) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 15 20:36:27.071761 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG passlib.handlers.bcrypt [None req-8bfcc320-eda7-4a08-b0a4-52f24901c8d6 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=98952) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 15 20:36:27.085589 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd91a6a-46ec-4e42-82c4-349b792cedd7 None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:27.109527 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:27.117767 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-8bfcc320-eda7-4a08-b0a4-52f24901c8d6 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:27.119398 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-8bfcc320-eda7-4a08-b0a4-52f24901c8d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:27.224717 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 7/13] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:36:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 20:36:27.248170 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfcc320-eda7-4a08-b0a4-52f24901c8d6 None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:27.301914 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd91a6a-46ec-4e42-82c4-349b792cedd7 None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:27.336769 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569da14d-7c68-43a0-99cd-c17accb7787c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:27.337582 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569da14d-7c68-43a0-99cd-c17accb7787c None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:27.337872 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569da14d-7c68-43a0-99cd-c17accb7787c None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:27.338187 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569da14d-7c68-43a0-99cd-c17accb7787c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:27.349221 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569da14d-7c68-43a0-99cd-c17accb7787c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:36:27.350775 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfcc320-eda7-4a08-b0a4-52f24901c8d6 None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:27.353052 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:27.360495 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-569da14d-7c68-43a0-99cd-c17accb7787c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:36:27.360495 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:36:27.360495 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:36:27.360495 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:36:27.360495 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:36:27.360495 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:36:27.360495 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:36:27.360495 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:36:27.360495 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:36:27.360495 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:36:27.360495 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:36:27.360495 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:36:27.360495 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:36:27.360495 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:36:27.360495 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:36:27.360495 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:36:27.361527 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:36:27.361527 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:36:27.361527 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:36:27.361527 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:36:27.361527 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:36:27.361527 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:36:27.361527 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:36:27.361527 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:36:27.361527 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:36:27.361527 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:36:27.361527 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:36:27.361527 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:36:27.361527 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:36:27.361527 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:36:27.361527 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:36:27.361527 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:36:27.362414 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:36:27.362414 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:36:27.362414 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:36:27.362414 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:36:27.362414 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:36:27.362414 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:36:27.362414 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:36:27.362414 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:36:27.362414 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:36:27.362414 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:36:27.362414 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:36:27.362414 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:36:27.362414 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 7/14] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Jul 15 20:36:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 20:36:27.368003 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569da14d-7c68-43a0-99cd-c17accb7787c None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:27.389863 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e37914-f5a7-4e87-b101-44eb36a4c6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:27.390787 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e37914-f5a7-4e87-b101-44eb36a4c6dc None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:27.391079 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e37914-f5a7-4e87-b101-44eb36a4c6dc None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:27.391997 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e37914-f5a7-4e87-b101-44eb36a4c6dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:27.450960 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:27.460022 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e37914-f5a7-4e87-b101-44eb36a4c6dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:27.461553 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e37914-f5a7-4e87-b101-44eb36a4c6dc None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:27.468837 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569da14d-7c68-43a0-99cd-c17accb7787c None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:27.504898 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb7ed7-d5a6-4c7f-8fce-f571c9c776be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:27.505563 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb7ed7-d5a6-4c7f-8fce-f571c9c776be None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:27.505853 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb7ed7-d5a6-4c7f-8fce-f571c9c776be None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:27.506186 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb7ed7-d5a6-4c7f-8fce-f571c9c776be None admin] PATH_INFO: `/v3/roles` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:27.506924 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fb7ed7-d5a6-4c7f-8fce-f571c9c776be None admin] RBAC: Adding query filter params (name=admin) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:36:27.507240 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fb7ed7-d5a6-4c7f-8fce-f571c9c776be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:27.508618 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fb7ed7-d5a6-4c7f-8fce-f571c9c776be None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:27.521027 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 8/15] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jul 15 20:36:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:36:27.526658 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb7ed7-d5a6-4c7f-8fce-f571c9c776be None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:27.561912 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 8/16] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jul 15 20:36:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 15 20:36:27.567998 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e37914-f5a7-4e87-b101-44eb36a4c6dc None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:27.570939 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:27.624968 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb7ed7-d5a6-4c7f-8fce-f571c9c776be None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:27.667632 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeaa9cd-35ba-4b8e-a9c8-5f9c73c4224b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:27.668505 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeaa9cd-35ba-4b8e-a9c8-5f9c73c4224b None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:27.668797 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeaa9cd-35ba-4b8e-a9c8-5f9c73c4224b None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:27.668992 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e37914-f5a7-4e87-b101-44eb36a4c6dc None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:27.669081 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeaa9cd-35ba-4b8e-a9c8-5f9c73c4224b None admin] PATH_INFO: `/v3/users/904f3e39010c4ee1ad10cdd271b0b153` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:27.670378 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeaa9cd-35ba-4b8e-a9c8-5f9c73c4224b None admin] RBAC: Authorizing `identity:get_user(user_id=904f3e39010c4ee1ad10cdd271b0b153)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:27.671848 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeaa9cd-35ba-4b8e-a9c8-5f9c73c4224b None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:27.674009 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 9/17] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jul 15 20:36:27 2022] GET /identity/v3/users/904f3e39010c4ee1ad10cdd271b0b153 => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:36:27.679352 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeaa9cd-35ba-4b8e-a9c8-5f9c73c4224b None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:27.694826 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:27.704330 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c5ddbf-4b08-4e0b-8bf7-9f4835bf354f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:27.705137 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c5ddbf-4b08-4e0b-8bf7-9f4835bf354f None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:27.705425 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c5ddbf-4b08-4e0b-8bf7-9f4835bf354f None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:27.705714 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c5ddbf-4b08-4e0b-8bf7-9f4835bf354f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:27.724653 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c5ddbf-4b08-4e0b-8bf7-9f4835bf354f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:27.726183 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c5ddbf-4b08-4e0b-8bf7-9f4835bf354f None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:27.746797 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-a0c5ddbf-4b08-4e0b-8bf7-9f4835bf354f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:36:27.746797 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:36:27.746797 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:36:27.746797 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:36:27.746797 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:36:27.746797 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:36:27.746797 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:36:27.746797 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:36:27.746797 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:36:27.746797 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:36:27.746797 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:36:27.746797 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:36:27.746797 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:36:27.746797 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:36:27.746797 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:36:27.747575 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:36:27.747575 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:36:27.747575 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:36:27.747575 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:36:27.747575 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:36:27.747575 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:36:27.747575 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:36:27.747575 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:36:27.747575 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:36:27.747575 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:36:27.747575 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:36:27.747575 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:36:27.747575 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:36:27.747575 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:36:27.747575 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:36:27.747575 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:36:27.747575 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:36:27.748347 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:36:27.748347 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:36:27.748347 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:36:27.748347 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:36:27.748347 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 9/18] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jul 15 20:36:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 20:36:27.753777 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c5ddbf-4b08-4e0b-8bf7-9f4835bf354f None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:27.789166 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeaa9cd-35ba-4b8e-a9c8-5f9c73c4224b None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:27.810159 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:27.828052 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7fd59d-1715-4872-ae54-39cf38e493dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:27.829340 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7fd59d-1715-4872-ae54-39cf38e493dc None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:27.829628 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7fd59d-1715-4872-ae54-39cf38e493dc None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:27.829907 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7fd59d-1715-4872-ae54-39cf38e493dc None admin] PATH_INFO: `/v3/domains/default` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:27.831142 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7fd59d-1715-4872-ae54-39cf38e493dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:27.832605 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7fd59d-1715-4872-ae54-39cf38e493dc None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:27.834230 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 10/19] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jul 15 20:36:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:36:27.840001 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7fd59d-1715-4872-ae54-39cf38e493dc None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:27.857240 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c5ddbf-4b08-4e0b-8bf7-9f4835bf354f None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:27.890259 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a19b240-8982-454a-8586-9846f27b5b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:27.890927 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a19b240-8982-454a-8586-9846f27b5b12 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:27.891771 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a19b240-8982-454a-8586-9846f27b5b12 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:27.892077 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a19b240-8982-454a-8586-9846f27b5b12 None admin] PATH_INFO: `/v3/domains` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:27.892802 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a19b240-8982-454a-8586-9846f27b5b12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:36:27.893116 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a19b240-8982-454a-8586-9846f27b5b12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:27.894537 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a19b240-8982-454a-8586-9846f27b5b12 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:27.921646 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:27.942388 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7fd59d-1715-4872-ae54-39cf38e493dc None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:27.978966 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de731aa-8575-4d14-8966-63355fbfbefc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:27.979618 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de731aa-8575-4d14-8966-63355fbfbefc None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:27.979910 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de731aa-8575-4d14-8966-63355fbfbefc None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:27.980191 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de731aa-8575-4d14-8966-63355fbfbefc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:27.981039 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de731aa-8575-4d14-8966-63355fbfbefc None admin] RBAC: Adding query filter params (role.id=cbcae224848142ce888ca5b84abfd18e, scope.domain.id=default, user.id=904f3e39010c4ee1ad10cdd271b0b153) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:36:27.981360 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de731aa-8575-4d14-8966-63355fbfbefc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:27.982853 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de731aa-8575-4d14-8966-63355fbfbefc None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:27.990788 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 11/20] 10.222.0.16 () {56 vars in 1322 bytes} [Fri Jul 15 20:36:27 2022] GET /identity/v3/role_assignments?user.id=904f3e39010c4ee1ad10cdd271b0b153&scope.domain.id=default&role.id=cbcae224848142ce888ca5b84abfd18e => generated 233 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:36:28.020135 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 10/21] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jul 15 20:36:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:36:30.741926 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5480e8b8-46a0-4b3a-9386-57f648deb6aa None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:30.743045 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5480e8b8-46a0-4b3a-9386-57f648deb6aa None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:30.743537 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5480e8b8-46a0-4b3a-9386-57f648deb6aa None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:30.745085 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 12/22] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:36:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:36:30.750740 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb1553-0168-40fa-98dd-6becd0ac3d81 None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:30.751186 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb1553-0168-40fa-98dd-6becd0ac3d81 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:30.751315 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb1553-0168-40fa-98dd-6becd0ac3d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:30.758045 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ef588-e82d-4b4c-a45d-1af4a12d73f1 None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:30.758647 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ef588-e82d-4b4c-a45d-1af4a12d73f1 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:30.759149 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ef588-e82d-4b4c-a45d-1af4a12d73f1 None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:30.760669 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 13/23] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:36:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 20:36:30.775255 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-96eb1553-0168-40fa-98dd-6becd0ac3d81 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:30.775814 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded8afb2-3e34-4622-88e0-390150a5cb8e None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:30.776307 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded8afb2-3e34-4622-88e0-390150a5cb8e None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:30.776480 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-96eb1553-0168-40fa-98dd-6becd0ac3d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:30.776867 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded8afb2-3e34-4622-88e0-390150a5cb8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:30.807140 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-ded8afb2-3e34-4622-88e0-390150a5cb8e None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:30.808743 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-ded8afb2-3e34-4622-88e0-390150a5cb8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:30.879459 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 11/24] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:36:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:36:30.919981 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eb1553-0168-40fa-98dd-6becd0ac3d81 None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:30.980632 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 14/25] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:36:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 20:36:30.997948 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:31.013571 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b22e7-dbb8-464f-8a13-cc34d333e4a2 None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:31.014226 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b22e7-dbb8-464f-8a13-cc34d333e4a2 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:31.014704 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b22e7-dbb8-464f-8a13-cc34d333e4a2 None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:31.016877 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 15/26] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:36:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 20:36:31.022143 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73b22e7-dbb8-464f-8a13-cc34d333e4a2 None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:31.083307 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eb1553-0168-40fa-98dd-6becd0ac3d81 None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:31.157199 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e15c70-8638-4f46-a53d-06d99ec1c61b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:31.158406 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e15c70-8638-4f46-a53d-06d99ec1c61b None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:31.158890 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e15c70-8638-4f46-a53d-06d99ec1c61b None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:31.159378 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e15c70-8638-4f46-a53d-06d99ec1c61b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:31.174444 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:31.184290 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e15c70-8638-4f46-a53d-06d99ec1c61b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:36:31.194772 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-48e15c70-8638-4f46-a53d-06d99ec1c61b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:36:31.194772 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:36:31.194772 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:36:31.194772 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:36:31.194772 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:36:31.194772 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:36:31.194772 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:36:31.194772 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:36:31.194772 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:36:31.194772 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:36:31.194772 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:36:31.194772 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:36:31.194772 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:36:31.194772 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:36:31.194772 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:36:31.194772 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:36:31.195605 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:36:31.195605 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:36:31.195605 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:36:31.195605 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:36:31.195605 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:36:31.195605 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:36:31.195605 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:36:31.195605 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:36:31.195605 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:36:31.195605 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:36:31.195605 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:36:31.195605 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:36:31.195605 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:36:31.195605 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:36:31.195605 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:36:31.195605 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:36:31.196322 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:36:31.196322 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:36:31.196322 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:36:31.196322 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:36:31.196322 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:36:31.196322 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:36:31.196322 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:36:31.196322 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:36:31.196322 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:36:31.196322 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:36:31.196322 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:36:31.196322 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:36:31.198663 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 12/27] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Jul 15 20:36:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 20:36:31.200098 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca031f99-685f-402f-9f05-645ae991bb18 None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:31.200588 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca031f99-685f-402f-9f05-645ae991bb18 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:31.201080 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca031f99-685f-402f-9f05-645ae991bb18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:31.219249 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-ca031f99-685f-402f-9f05-645ae991bb18 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:31.220809 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-ca031f99-685f-402f-9f05-645ae991bb18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:31.241109 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73b22e7-dbb8-464f-8a13-cc34d333e4a2 None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:31.316335 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91449d9a-0e61-4af4-8ad5-9463e1f7a7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:31.318772 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91449d9a-0e61-4af4-8ad5-9463e1f7a7fc None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:31.319727 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91449d9a-0e61-4af4-8ad5-9463e1f7a7fc None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:31.321428 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91449d9a-0e61-4af4-8ad5-9463e1f7a7fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:31.342616 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 13/28] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:36:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:36:31.343728 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91449d9a-0e61-4af4-8ad5-9463e1f7a7fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:31.344868 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca031f99-685f-402f-9f05-645ae991bb18 None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:31.346577 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91449d9a-0e61-4af4-8ad5-9463e1f7a7fc None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:31.376936 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-91449d9a-0e61-4af4-8ad5-9463e1f7a7fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:36:31.376936 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:36:31.376936 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:36:31.376936 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:36:31.376936 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:36:31.376936 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:36:31.376936 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:36:31.376936 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:36:31.376936 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:36:31.376936 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:36:31.376936 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:36:31.376936 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:36:31.376936 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:36:31.376936 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:36:31.376936 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:36:31.377795 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:36:31.377795 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:36:31.377795 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:36:31.377795 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:36:31.377795 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:36:31.377795 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:36:31.377795 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:36:31.377795 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:36:31.377795 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:36:31.377795 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:36:31.377795 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:36:31.377795 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:36:31.377795 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:36:31.377795 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:36:31.377795 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:36:31.377795 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:36:31.377795 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:36:31.380190 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:36:31.380190 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:36:31.380190 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:36:31.380190 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:36:31.389120 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 16/29] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jul 15 20:36:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 20:36:31.392603 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91449d9a-0e61-4af4-8ad5-9463e1f7a7fc None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:31.411578 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:31.523493 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca031f99-685f-402f-9f05-645ae991bb18 None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:31.560716 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91449d9a-0e61-4af4-8ad5-9463e1f7a7fc None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:31.561372 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9b859e-e85f-4ab5-b3ec-af7eb7f5b842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:31.562428 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9b859e-e85f-4ab5-b3ec-af7eb7f5b842 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:31.562973 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9b859e-e85f-4ab5-b3ec-af7eb7f5b842 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:31.563952 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9b859e-e85f-4ab5-b3ec-af7eb7f5b842 None admin] PATH_INFO: `/v3/roles` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:31.564848 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9b859e-e85f-4ab5-b3ec-af7eb7f5b842 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:36:31.565305 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9b859e-e85f-4ab5-b3ec-af7eb7f5b842 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:31.566914 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9b859e-e85f-4ab5-b3ec-af7eb7f5b842 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:31.580870 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 14/30] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jul 15 20:36:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:36:31.582093 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9b859e-e85f-4ab5-b3ec-af7eb7f5b842 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:31.592338 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:31.603254 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faaee54-5fdc-4f45-bd50-8da798f74cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:31.603927 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faaee54-5fdc-4f45-bd50-8da798f74cb0 None admin] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:31.604469 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faaee54-5fdc-4f45-bd50-8da798f74cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:31.604755 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faaee54-5fdc-4f45-bd50-8da798f74cb0 None admin] PATH_INFO: `/v3/roles` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:31.605886 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faaee54-5fdc-4f45-bd50-8da798f74cb0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:31.607314 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faaee54-5fdc-4f45-bd50-8da798f74cb0 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:31.699414 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:31.703571 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9b859e-e85f-4ab5-b3ec-af7eb7f5b842 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:31.741306 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c690069-6e06-49d1-85c0-712ee93fbe45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:31.742232 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c690069-6e06-49d1-85c0-712ee93fbe45 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:31.742660 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c690069-6e06-49d1-85c0-712ee93fbe45 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:31.743078 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c690069-6e06-49d1-85c0-712ee93fbe45 None admin] PATH_INFO: `/v3/domains` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:31.743973 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c690069-6e06-49d1-85c0-712ee93fbe45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:36:31.744418 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c690069-6e06-49d1-85c0-712ee93fbe45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:31.745934 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c690069-6e06-49d1-85c0-712ee93fbe45 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:31.748457 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 17/31] 10.222.0.16 () {60 vars in 1131 bytes} [Fri Jul 15 20:36:31 2022] POST /identity/v3/roles => generated 225 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:36:31.750515 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df81f535-c095-4633-8ce1-eabdc2332dbc None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:31.751585 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df81f535-c095-4633-8ce1-eabdc2332dbc None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:31.752037 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df81f535-c095-4633-8ce1-eabdc2332dbc None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:31.753524 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 18/32] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:36:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:36:31.754675 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df81f535-c095-4633-8ce1-eabdc2332dbc None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:31.759898 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 15/33] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jul 15 20:36:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:36:31.761233 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83bba79-4b8e-459f-8ea4-35b37aa99948 None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:31.761529 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83bba79-4b8e-459f-8ea4-35b37aa99948 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:31.761810 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83bba79-4b8e-459f-8ea4-35b37aa99948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:31.785621 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-a83bba79-4b8e-459f-8ea4-35b37aa99948 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:31.787134 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-a83bba79-4b8e-459f-8ea4-35b37aa99948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:31.862577 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 16/34] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:36:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:36:31.863718 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83bba79-4b8e-459f-8ea4-35b37aa99948 None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:31.873878 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df81f535-c095-4633-8ce1-eabdc2332dbc None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:31.921754 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4f2a85-5f26-4d34-946e-accc4af7ce8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:31.927092 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4f2a85-5f26-4d34-946e-accc4af7ce8d None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:31.927623 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4f2a85-5f26-4d34-946e-accc4af7ce8d None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:31.928062 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4f2a85-5f26-4d34-946e-accc4af7ce8d None admin] PATH_INFO: `/v3/users/904f3e39010c4ee1ad10cdd271b0b153` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:31.929737 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4f2a85-5f26-4d34-946e-accc4af7ce8d None admin] RBAC: Authorizing `identity:get_user(user_id=904f3e39010c4ee1ad10cdd271b0b153)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:31.931617 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4f2a85-5f26-4d34-946e-accc4af7ce8d None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:31.933702 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 19/35] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jul 15 20:36:31 2022] GET /identity/v3/users/904f3e39010c4ee1ad10cdd271b0b153 => generated 247 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:36:31.934694 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4f2a85-5f26-4d34-946e-accc4af7ce8d None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:31.967170 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:31.983580 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83bba79-4b8e-459f-8ea4-35b37aa99948 None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:32.011947 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:32.023742 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde16d9b-eee8-4c6d-9a41-918a903ba86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:32.024435 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde16d9b-eee8-4c6d-9a41-918a903ba86a None admin] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:32.024722 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde16d9b-eee8-4c6d-9a41-918a903ba86a None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:32.025047 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde16d9b-eee8-4c6d-9a41-918a903ba86a None admin] PATH_INFO: `/v3/projects` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:32.026006 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde16d9b-eee8-4c6d-9a41-918a903ba86a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:32.027651 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde16d9b-eee8-4c6d-9a41-918a903ba86a None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:32.081596 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4f2a85-5f26-4d34-946e-accc4af7ce8d None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:32.123906 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcb82b9-f8fc-4af9-bc0a-77ddc0f37b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:32.124786 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb82b9-f8fc-4af9-bc0a-77ddc0f37b0e None admin] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:32.125228 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb82b9-f8fc-4af9-bc0a-77ddc0f37b0e None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:32.125528 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb82b9-f8fc-4af9-bc0a-77ddc0f37b0e None admin] PATH_INFO: `/v3/roles` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:32.126335 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcb82b9-f8fc-4af9-bc0a-77ddc0f37b0e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:32.127905 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcb82b9-f8fc-4af9-bc0a-77ddc0f37b0e None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:32.143493 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 20/36] 10.222.0.16 () {60 vars in 1131 bytes} [Fri Jul 15 20:36:31 2022] POST /identity/v3/roles => generated 219 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:36:32.144112 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcb82b9-f8fc-4af9-bc0a-77ddc0f37b0e None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:32.192668 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 17/37] 10.222.0.16 () {60 vars in 1141 bytes} [Fri Jul 15 20:36:31 2022] POST /identity/v3/projects => generated 301 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:36:32.195010 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37666dc8-9bed-4393-87a9-2ecdb6c49f32 None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:32.195482 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37666dc8-9bed-4393-87a9-2ecdb6c49f32 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:32.196021 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37666dc8-9bed-4393-87a9-2ecdb6c49f32 None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:32.197592 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 18/38] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:36:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:36:32.204753 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b42a1e-66bc-4949-8ec5-277d56cc342c None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:32.207448 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b42a1e-66bc-4949-8ec5-277d56cc342c None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:32.208013 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b42a1e-66bc-4949-8ec5-277d56cc342c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:32.237222 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-93b42a1e-66bc-4949-8ec5-277d56cc342c None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:32.239208 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-93b42a1e-66bc-4949-8ec5-277d56cc342c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:32.302337 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcb82b9-f8fc-4af9-bc0a-77ddc0f37b0e None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:32.320086 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:32.343632 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b77930-7d99-4166-8e32-940ca084b0c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:32.344557 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b77930-7d99-4166-8e32-940ca084b0c8 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:32.344842 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b77930-7d99-4166-8e32-940ca084b0c8 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:32.345128 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b77930-7d99-4166-8e32-940ca084b0c8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:32.346701 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b77930-7d99-4166-8e32-940ca084b0c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:32.348330 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b77930-7d99-4166-8e32-940ca084b0c8 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:32.350113 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 21/39] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jul 15 20:36:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:36:32.355951 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b77930-7d99-4166-8e32-940ca084b0c8 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:32.359353 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 19/40] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:36:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 20:36:32.395506 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b42a1e-66bc-4949-8ec5-277d56cc342c None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:32.498237 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b77930-7d99-4166-8e32-940ca084b0c8 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:32.499908 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:32.542439 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b42a1e-66bc-4949-8ec5-277d56cc342c None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:32.544160 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eef91cf-62b9-4817-ad80-d599889a25e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:32.545051 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef91cf-62b9-4817-ad80-d599889a25e9 None admin] REQUEST_METHOD: `PUT` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:32.545348 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef91cf-62b9-4817-ad80-d599889a25e9 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:32.545642 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef91cf-62b9-4817-ad80-d599889a25e9 None admin] PATH_INFO: `/v3/domains/default/users/904f3e39010c4ee1ad10cdd271b0b153/roles/cbcae224848142ce888ca5b84abfd18e` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:32.548275 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eef91cf-62b9-4817-ad80-d599889a25e9 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=904f3e39010c4ee1ad10cdd271b0b153, role_id=cbcae224848142ce888ca5b84abfd18e)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:32.549739 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eef91cf-62b9-4817-ad80-d599889a25e9 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:32.565192 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 22/41] 10.222.0.16 () {58 vars in 1361 bytes} [Fri Jul 15 20:36:32 2022] PUT /identity/v3/domains/default/users/904f3e39010c4ee1ad10cdd271b0b153/roles/cbcae224848142ce888ca5b84abfd18e => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 20:36:32.566979 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b06e31-f79f-4c98-a31c-381b1dc417a5 None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:32.567282 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b06e31-f79f-4c98-a31c-381b1dc417a5 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:32.567570 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b06e31-f79f-4c98-a31c-381b1dc417a5 None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:32.573853 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 23/42] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:36:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:36:32.575424 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55e7f3-cfe5-4ddb-a85c-8ad85329349f None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:32.575655 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55e7f3-cfe5-4ddb-a85c-8ad85329349f None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:32.576063 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55e7f3-cfe5-4ddb-a85c-8ad85329349f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:32.580746 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e6fa1e-c6d9-4420-aaed-9c0df7222fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:32.581443 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e6fa1e-c6d9-4420-aaed-9c0df7222fb9 None admin] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:32.581740 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e6fa1e-c6d9-4420-aaed-9c0df7222fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:32.582030 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e6fa1e-c6d9-4420-aaed-9c0df7222fb9 None admin] PATH_INFO: `/v3/roles` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:32.582860 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e6fa1e-c6d9-4420-aaed-9c0df7222fb9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:32.584459 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e6fa1e-c6d9-4420-aaed-9c0df7222fb9 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:32.597312 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-7c55e7f3-cfe5-4ddb-a85c-8ad85329349f None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:32.599019 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-7c55e7f3-cfe5-4ddb-a85c-8ad85329349f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:32.604894 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 20/43] 10.222.0.16 () {60 vars in 1131 bytes} [Fri Jul 15 20:36:32 2022] POST /identity/v3/roles => generated 223 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 20:36:32.647252 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:32.689608 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 24/44] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:36:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:36:32.714567 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e6fa1e-c6d9-4420-aaed-9c0df7222fb9 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:32.835470 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e6fa1e-c6d9-4420-aaed-9c0df7222fb9 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:32.865566 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:32.872796 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85960a6b-1c0e-457a-b164-0b34bb9a75a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:32.873813 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85960a6b-1c0e-457a-b164-0b34bb9a75a5 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:32.874318 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85960a6b-1c0e-457a-b164-0b34bb9a75a5 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:32.874807 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85960a6b-1c0e-457a-b164-0b34bb9a75a5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:32.876039 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85960a6b-1c0e-457a-b164-0b34bb9a75a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:32.877538 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85960a6b-1c0e-457a-b164-0b34bb9a75a5 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:32.879218 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 21/45] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jul 15 20:36:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:36:32.884761 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c55e7f3-cfe5-4ddb-a85c-8ad85329349f None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:32.983001 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c55e7f3-cfe5-4ddb-a85c-8ad85329349f None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:33.015139 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a7e398-55d8-4e53-bd48-ad00337f8fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:33.015798 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a7e398-55d8-4e53-bd48-ad00337f8fdd None admin] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:33.016090 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a7e398-55d8-4e53-bd48-ad00337f8fdd None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:33.016903 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a7e398-55d8-4e53-bd48-ad00337f8fdd None admin] PATH_INFO: `/v3/projects` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:33.017676 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a7e398-55d8-4e53-bd48-ad00337f8fdd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:33.019159 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a7e398-55d8-4e53-bd48-ad00337f8fdd None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:33.045264 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 25/46] 10.222.0.16 () {60 vars in 1141 bytes} [Fri Jul 15 20:36:32 2022] POST /identity/v3/projects => generated 312 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:36:34.836480 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2dc670-7894-48f3-a3af-bdc9f855b86e None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:34.836967 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2dc670-7894-48f3-a3af-bdc9f855b86e None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:34.836967 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2dc670-7894-48f3-a3af-bdc9f855b86e None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:34.838361 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 22/47] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:36:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:36:34.843552 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37749d21-f168-437d-9f41-5c6c5bddcaac None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:34.843962 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37749d21-f168-437d-9f41-5c6c5bddcaac None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:34.844139 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37749d21-f168-437d-9f41-5c6c5bddcaac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:34.860779 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-37749d21-f168-437d-9f41-5c6c5bddcaac None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:34.861969 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-37749d21-f168-437d-9f41-5c6c5bddcaac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:34.879693 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:34.929021 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 26/48] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:36:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:36:34.954405 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2dc670-7894-48f3-a3af-bdc9f855b86e None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:35.053641 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2dc670-7894-48f3-a3af-bdc9f855b86e None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:35.087361 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a6384-805a-454d-85c6-daccae84add1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:35.088089 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a6384-805a-454d-85c6-daccae84add1 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:35.088388 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a6384-805a-454d-85c6-daccae84add1 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:35.088673 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a6384-805a-454d-85c6-daccae84add1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:35.098762 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6a6384-805a-454d-85c6-daccae84add1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:36:35.106478 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-1e6a6384-805a-454d-85c6-daccae84add1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:36:35.106478 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:36:35.106478 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:36:35.106478 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:36:35.106478 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:36:35.106478 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:36:35.106478 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:36:35.106478 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:36:35.106478 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:36:35.106478 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:36:35.106478 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:36:35.106478 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:36:35.106478 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:36:35.106478 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:36:35.106478 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:36:35.106478 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:36:35.107315 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:36:35.107315 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:36:35.107315 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:36:35.107315 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:36:35.107315 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:36:35.107315 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:36:35.107315 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:36:35.107315 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:36:35.107315 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:36:35.107315 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:36:35.107315 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:36:35.107315 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:36:35.107315 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:36:35.107315 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:36:35.107315 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:36:35.107315 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:36:35.108062 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:36:35.108062 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:36:35.108062 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:36:35.108062 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:36:35.108062 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:36:35.108062 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:36:35.108062 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:36:35.108062 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:36:35.108062 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:36:35.108062 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:36:35.108062 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:36:35.108062 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:36:35.108062 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 23/49] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Jul 15 20:36:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:36:35.114109 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37749d21-f168-437d-9f41-5c6c5bddcaac None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:35.221163 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37749d21-f168-437d-9f41-5c6c5bddcaac None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:35.253680 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4b1f68-f136-4449-b145-80b156bb60f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:35.254384 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4b1f68-f136-4449-b145-80b156bb60f0 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:35.254675 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4b1f68-f136-4449-b145-80b156bb60f0 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:35.254956 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4b1f68-f136-4449-b145-80b156bb60f0 None admin] PATH_INFO: `/v3/roles` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:35.255704 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4b1f68-f136-4449-b145-80b156bb60f0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:36:35.256019 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4b1f68-f136-4449-b145-80b156bb60f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:35.257406 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4b1f68-f136-4449-b145-80b156bb60f0 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:35.265511 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 27/50] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jul 15 20:36:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:36:35.271725 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a6384-805a-454d-85c6-daccae84add1 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:35.296015 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a324ac-e793-4e54-9499-d3f3277b5a38 None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:35.296302 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a324ac-e793-4e54-9499-d3f3277b5a38 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:35.296582 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a324ac-e793-4e54-9499-d3f3277b5a38 None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:35.298066 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 28/51] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:36:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 20:36:35.302816 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1fa5fc-c1d5-403c-8e4f-64dbe45e852d None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:35.303110 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1fa5fc-c1d5-403c-8e4f-64dbe45e852d None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:35.303395 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1fa5fc-c1d5-403c-8e4f-64dbe45e852d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:35.319713 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-ea1fa5fc-c1d5-403c-8e4f-64dbe45e852d None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:35.320931 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-ea1fa5fc-c1d5-403c-8e4f-64dbe45e852d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:35.331614 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:35.332073 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:35.382866 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a6384-805a-454d-85c6-daccae84add1 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:35.395626 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 29/52] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:36:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 20:36:35.416694 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aeb336-2419-4b71-8d3e-518aad3f0579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:35.417564 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aeb336-2419-4b71-8d3e-518aad3f0579 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:35.417855 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aeb336-2419-4b71-8d3e-518aad3f0579 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:35.418166 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aeb336-2419-4b71-8d3e-518aad3f0579 None admin] PATH_INFO: `/v3/users/904f3e39010c4ee1ad10cdd271b0b153` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:35.419579 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aeb336-2419-4b71-8d3e-518aad3f0579 None admin] RBAC: Authorizing `identity:get_user(user_id=904f3e39010c4ee1ad10cdd271b0b153)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:35.420364 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1fa5fc-c1d5-403c-8e4f-64dbe45e852d None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:35.421060 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aeb336-2419-4b71-8d3e-518aad3f0579 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:35.422739 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 24/53] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jul 15 20:36:35 2022] GET /identity/v3/users/904f3e39010c4ee1ad10cdd271b0b153 => generated 247 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:36:35.428005 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aeb336-2419-4b71-8d3e-518aad3f0579 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:35.520589 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1fa5fc-c1d5-403c-8e4f-64dbe45e852d None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:35.532395 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aeb336-2419-4b71-8d3e-518aad3f0579 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:35.556226 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b421bc9-7b69-476a-a5a9-a7b1fefcbfa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:35.557116 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b421bc9-7b69-476a-a5a9-a7b1fefcbfa4 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:35.557413 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b421bc9-7b69-476a-a5a9-a7b1fefcbfa4 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:35.557695 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b421bc9-7b69-476a-a5a9-a7b1fefcbfa4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:35.557814 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:35.559462 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b421bc9-7b69-476a-a5a9-a7b1fefcbfa4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:35.560947 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b421bc9-7b69-476a-a5a9-a7b1fefcbfa4 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:35.562601 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 30/54] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jul 15 20:36:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:36:35.566987 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d261cc33-c5a0-43f2-81e6-a1f2180d311a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:35.567839 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d261cc33-c5a0-43f2-81e6-a1f2180d311a None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:35.568133 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d261cc33-c5a0-43f2-81e6-a1f2180d311a None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:35.568220 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b421bc9-7b69-476a-a5a9-a7b1fefcbfa4 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:35.568414 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d261cc33-c5a0-43f2-81e6-a1f2180d311a None admin] PATH_INFO: `/v3/domains/default` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:35.569858 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d261cc33-c5a0-43f2-81e6-a1f2180d311a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:35.571359 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d261cc33-c5a0-43f2-81e6-a1f2180d311a None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:35.577436 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 25/55] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jul 15 20:36:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:36:35.578353 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d261cc33-c5a0-43f2-81e6-a1f2180d311a None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:35.584409 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:35.668183 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b421bc9-7b69-476a-a5a9-a7b1fefcbfa4 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:35.676188 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d261cc33-c5a0-43f2-81e6-a1f2180d311a None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:35.701927 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1edec51-a486-4663-a46d-2f0e3a23abb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:35.702610 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1edec51-a486-4663-a46d-2f0e3a23abb9 None admin] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:35.702900 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1edec51-a486-4663-a46d-2f0e3a23abb9 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:35.703182 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1edec51-a486-4663-a46d-2f0e3a23abb9 None admin] PATH_INFO: `/v3/projects` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:35.704082 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1edec51-a486-4663-a46d-2f0e3a23abb9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:35.705526 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1edec51-a486-4663-a46d-2f0e3a23abb9 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:35.710101 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8939e3-9524-41c5-8552-dc3cf8affa45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:35.710767 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8939e3-9524-41c5-8552-dc3cf8affa45 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:35.711063 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8939e3-9524-41c5-8552-dc3cf8affa45 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:35.711351 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8939e3-9524-41c5-8552-dc3cf8affa45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:35.712179 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8939e3-9524-41c5-8552-dc3cf8affa45 None admin] RBAC: Adding query filter params (role.id=cbcae224848142ce888ca5b84abfd18e, scope.domain.id=default, user.id=904f3e39010c4ee1ad10cdd271b0b153) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:36:35.712500 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8939e3-9524-41c5-8552-dc3cf8affa45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:35.713923 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8939e3-9524-41c5-8552-dc3cf8affa45 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:35.723286 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 26/56] 10.222.0.16 () {56 vars in 1322 bytes} [Fri Jul 15 20:36:35 2022] GET /identity/v3/role_assignments?user.id=904f3e39010c4ee1ad10cdd271b0b153&scope.domain.id=default&role.id=cbcae224848142ce888ca5b84abfd18e => generated 530 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:36:35.737622 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 31/57] 10.222.0.16 () {60 vars in 1140 bytes} [Fri Jul 15 20:36:35 2022] POST /identity/v3/projects => generated 298 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 20:36:37.975161 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c2993-7e60-4f32-80ad-26f46c5eeba9 None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:37.975674 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c2993-7e60-4f32-80ad-26f46c5eeba9 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:37.975780 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c2993-7e60-4f32-80ad-26f46c5eeba9 None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:37.977172 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 27/58] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:36:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:36:37.982237 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a7ad08-3f43-4cfe-aa2d-04b9032bf6ea None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:37.982624 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a7ad08-3f43-4cfe-aa2d-04b9032bf6ea None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:37.982807 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a7ad08-3f43-4cfe-aa2d-04b9032bf6ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:37.999615 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-c7a7ad08-3f43-4cfe-aa2d-04b9032bf6ea None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:38.000900 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-c7a7ad08-3f43-4cfe-aa2d-04b9032bf6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:38.058011 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:38.066514 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 32/59] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:36:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:36:38.091307 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579c2993-7e60-4f32-80ad-26f46c5eeba9 None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:38.150302 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:38.196737 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579c2993-7e60-4f32-80ad-26f46c5eeba9 None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:38.235464 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c41c79e-5fd7-42af-8a16-fd42fb992f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:38.236187 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41c79e-5fd7-42af-8a16-fd42fb992f8b None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:38.236476 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41c79e-5fd7-42af-8a16-fd42fb992f8b None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:38.236789 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41c79e-5fd7-42af-8a16-fd42fb992f8b None admin] PATH_INFO: `/v3/domains/default` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:38.237960 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c41c79e-5fd7-42af-8a16-fd42fb992f8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:38.239429 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c41c79e-5fd7-42af-8a16-fd42fb992f8b None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:38.241027 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 28/60] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jul 15 20:36:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:36:38.246641 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a7ad08-3f43-4cfe-aa2d-04b9032bf6ea None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:38.344027 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a7ad08-3f43-4cfe-aa2d-04b9032bf6ea None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:38.376847 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566a81e9-8669-4532-8cda-327051e1bb20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:38.377511 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a81e9-8669-4532-8cda-327051e1bb20 None admin] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:38.377805 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a81e9-8669-4532-8cda-327051e1bb20 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:38.378115 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a81e9-8669-4532-8cda-327051e1bb20 None admin] PATH_INFO: `/v3/users` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:38.378825 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566a81e9-8669-4532-8cda-327051e1bb20 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:38.380301 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566a81e9-8669-4532-8cda-327051e1bb20 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:38.404857 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 33/61] 10.222.0.16 () {60 vars in 1132 bytes} [Fri Jul 15 20:36:38 2022] POST /identity/v3/users => generated 275 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:36:42.037518 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6097254-79d7-4348-b85b-41058ce21fbe None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:42.038386 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6097254-79d7-4348-b85b-41058ce21fbe None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:42.038818 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6097254-79d7-4348-b85b-41058ce21fbe None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:42.040576 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 29/62] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:36:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:36:42.057599 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477fe8aa-41ad-466f-80ef-00ec8f0d4b90 None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:42.058468 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477fe8aa-41ad-466f-80ef-00ec8f0d4b90 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:42.058900 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477fe8aa-41ad-466f-80ef-00ec8f0d4b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:42.087103 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-477fe8aa-41ad-466f-80ef-00ec8f0d4b90 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:42.088542 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-477fe8aa-41ad-466f-80ef-00ec8f0d4b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:42.139343 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:42.164182 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 34/63] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:36:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:36:42.237666 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6097254-79d7-4348-b85b-41058ce21fbe None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:42.375851 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6097254-79d7-4348-b85b-41058ce21fbe None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:42.410224 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:42.419383 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc9c130-bce6-41d0-bc9a-5f04267e433e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:42.420206 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc9c130-bce6-41d0-bc9a-5f04267e433e None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:42.426465 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc9c130-bce6-41d0-bc9a-5f04267e433e None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:42.426769 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc9c130-bce6-41d0-bc9a-5f04267e433e None admin] PATH_INFO: `/v3/roles/member` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:42.442321 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc9c130-bce6-41d0-bc9a-5f04267e433e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:36:42.455727 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-bcc9c130-bce6-41d0-bc9a-5f04267e433e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 20:36:42.455727 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:36:42.455727 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:36:42.455727 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:36:42.455727 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:36:42.455727 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:36:42.455727 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:36:42.455727 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:36:42.455727 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:36:42.455727 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:36:42.455727 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:36:42.455727 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:36:42.455727 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:36:42.455727 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:36:42.455727 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:36:42.455727 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:36:42.456594 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:36:42.456594 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:36:42.456594 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:36:42.456594 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:36:42.456594 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:36:42.456594 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:36:42.456594 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:36:42.456594 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:36:42.456594 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:36:42.456594 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:36:42.456594 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:36:42.456594 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:36:42.456594 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:36:42.456594 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:36:42.456594 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:36:42.456594 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:36:42.457330 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:36:42.457330 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:36:42.457330 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:36:42.457330 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:36:42.457330 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:36:42.457330 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:36:42.457330 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:36:42.457330 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:36:42.457330 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:36:42.457330 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:36:42.457330 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 20:36:42.457330 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:36:42.457330 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 30/64] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jul 15 20:36:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:36:42.465439 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477fe8aa-41ad-466f-80ef-00ec8f0d4b90 None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:42.497783 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b22cd8-a9ab-431f-bd52-b9bfd40f6ac1 None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:42.498120 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b22cd8-a9ab-431f-bd52-b9bfd40f6ac1 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:42.498401 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b22cd8-a9ab-431f-bd52-b9bfd40f6ac1 None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:42.500660 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 31/65] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:36:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:36:42.505268 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1705d969-4573-47ab-a4d2-cd8f32f7b392 None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:42.505565 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1705d969-4573-47ab-a4d2-cd8f32f7b392 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:42.505851 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1705d969-4573-47ab-a4d2-cd8f32f7b392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:42.539167 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-1705d969-4573-47ab-a4d2-cd8f32f7b392 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:42.540419 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-1705d969-4573-47ab-a4d2-cd8f32f7b392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:42.663727 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477fe8aa-41ad-466f-80ef-00ec8f0d4b90 None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:42.687496 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 32/66] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:36:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 20:36:42.712536 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1705d969-4573-47ab-a4d2-cd8f32f7b392 None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:42.756875 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c897a0-298f-4425-9123-2b7bb98cd4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:42.757605 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c897a0-298f-4425-9123-2b7bb98cd4dd None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:42.757884 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c897a0-298f-4425-9123-2b7bb98cd4dd None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:42.758135 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c897a0-298f-4425-9123-2b7bb98cd4dd None admin] PATH_INFO: `/v3/roles` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:42.758900 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c897a0-298f-4425-9123-2b7bb98cd4dd None admin] RBAC: Adding query filter params (name=member) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:36:42.759216 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c897a0-298f-4425-9123-2b7bb98cd4dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:42.760611 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c897a0-298f-4425-9123-2b7bb98cd4dd None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:42.782646 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 35/67] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Jul 15 20:36:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:36:42.792743 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c897a0-298f-4425-9123-2b7bb98cd4dd None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:42.885733 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1705d969-4573-47ab-a4d2-cd8f32f7b392 None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:42.888213 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:42.904390 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:42.923972 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14667211-e1b8-4df8-a653-48055744bfe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:42.924788 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14667211-e1b8-4df8-a653-48055744bfe3 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:42.925082 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14667211-e1b8-4df8-a653-48055744bfe3 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:42.925369 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14667211-e1b8-4df8-a653-48055744bfe3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:42.935968 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14667211-e1b8-4df8-a653-48055744bfe3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:36:42.944017 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-14667211-e1b8-4df8-a653-48055744bfe3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:36:42.944017 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:36:42.944017 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:36:42.944017 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:36:42.944017 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:36:42.944017 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:36:42.944017 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:36:42.944017 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:36:42.944017 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:36:42.944017 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:36:42.944017 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:36:42.944017 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:36:42.944017 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:36:42.944017 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:36:42.944017 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:36:42.944017 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:36:42.945834 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:36:42.945834 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:36:42.945834 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:36:42.945834 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:36:42.945834 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:36:42.945834 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:36:42.945834 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:36:42.945834 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:36:42.945834 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:36:42.945834 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:36:42.945834 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:36:42.945834 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:36:42.945834 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:36:42.945834 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:36:42.945834 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:36:42.945834 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:36:42.948133 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:36:42.948133 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:36:42.948133 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:36:42.948133 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:36:42.948133 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:36:42.948133 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:36:42.948133 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:36:42.948133 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:36:42.948133 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:36:42.948133 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:36:42.948133 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:36:42.948133 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:36:42.948133 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 33/68] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Jul 15 20:36:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 20:36:42.952466 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14667211-e1b8-4df8-a653-48055744bfe3 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:43.025202 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c897a0-298f-4425-9123-2b7bb98cd4dd None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:43.087340 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d56666-6547-46ec-b0e7-b9e7eabba542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:43.088971 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d56666-6547-46ec-b0e7-b9e7eabba542 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:43.089269 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d56666-6547-46ec-b0e7-b9e7eabba542 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:43.089684 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d56666-6547-46ec-b0e7-b9e7eabba542 None admin] PATH_INFO: `/v3/users/bbd59331bbaf47468ccbb663718c3841` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:43.108072 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d56666-6547-46ec-b0e7-b9e7eabba542 None admin] RBAC: Authorizing `identity:get_user(user_id=bbd59331bbaf47468ccbb663718c3841)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:43.109544 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d56666-6547-46ec-b0e7-b9e7eabba542 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:43.109903 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14667211-e1b8-4df8-a653-48055744bfe3 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:43.111366 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 36/69] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jul 15 20:36:42 2022] GET /identity/v3/users/bbd59331bbaf47468ccbb663718c3841 => generated 275 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:36:43.112705 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05160c98-5b10-4c94-a304-0f6159a46a3c None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:43.113015 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05160c98-5b10-4c94-a304-0f6159a46a3c None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:43.113288 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05160c98-5b10-4c94-a304-0f6159a46a3c None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:43.114551 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 37/70] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:36:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:36:43.119854 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac06c68-8f97-490c-900d-0d4dcf1a4c71 None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:43.120155 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac06c68-8f97-490c-900d-0d4dcf1a4c71 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:43.120448 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac06c68-8f97-490c-900d-0d4dcf1a4c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:43.137485 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-dac06c68-8f97-490c-900d-0d4dcf1a4c71 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:43.138827 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-dac06c68-8f97-490c-900d-0d4dcf1a4c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:43.151714 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b4a2f2-5eac-49ea-9742-7ba65d3091d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:43.152397 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b4a2f2-5eac-49ea-9742-7ba65d3091d7 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:43.152856 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b4a2f2-5eac-49ea-9742-7ba65d3091d7 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:43.153147 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b4a2f2-5eac-49ea-9742-7ba65d3091d7 None admin] PATH_INFO: `/v3/roles` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:43.154311 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b4a2f2-5eac-49ea-9742-7ba65d3091d7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:36:43.154913 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b4a2f2-5eac-49ea-9742-7ba65d3091d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:43.156521 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b4a2f2-5eac-49ea-9742-7ba65d3091d7 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:43.167809 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 34/71] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jul 15 20:36:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:36:43.170698 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b4a2f2-5eac-49ea-9742-7ba65d3091d7 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:43.215228 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:43.220316 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 38/72] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:36:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 20:36:43.221368 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac06c68-8f97-490c-900d-0d4dcf1a4c71 None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:43.264840 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:43.327935 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac06c68-8f97-490c-900d-0d4dcf1a4c71 None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:43.328222 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b4a2f2-5eac-49ea-9742-7ba65d3091d7 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:43.362439 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfce0ae-5cab-438e-9635-d4f8441e1827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:43.362614 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b141388-17b4-49d5-ba2f-363c92815bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:43.363203 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b141388-17b4-49d5-ba2f-363c92815bc4 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:43.363377 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfce0ae-5cab-438e-9635-d4f8441e1827 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:43.363486 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b141388-17b4-49d5-ba2f-363c92815bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:43.363676 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfce0ae-5cab-438e-9635-d4f8441e1827 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:43.363762 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b141388-17b4-49d5-ba2f-363c92815bc4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:43.363959 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfce0ae-5cab-438e-9635-d4f8441e1827 None admin] PATH_INFO: `/v3/users/904f3e39010c4ee1ad10cdd271b0b153` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:43.365157 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfce0ae-5cab-438e-9635-d4f8441e1827 None admin] RBAC: Authorizing `identity:get_user(user_id=904f3e39010c4ee1ad10cdd271b0b153)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:43.366659 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfce0ae-5cab-438e-9635-d4f8441e1827 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:43.368283 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 39/73] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jul 15 20:36:43 2022] GET /identity/v3/users/904f3e39010c4ee1ad10cdd271b0b153 => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:36:43.369459 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfd829b-7c08-4640-9269-6df7bc110622 None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:43.369756 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfd829b-7c08-4640-9269-6df7bc110622 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:43.370043 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfd829b-7c08-4640-9269-6df7bc110622 None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:43.371474 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 40/74] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:36:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:36:43.371994 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfd829b-7c08-4640-9269-6df7bc110622 None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:43.432853 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b141388-17b4-49d5-ba2f-363c92815bc4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:43.434345 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b141388-17b4-49d5-ba2f-363c92815bc4 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:43.474797 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:43.474963 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:43.478950 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfd829b-7c08-4640-9269-6df7bc110622 None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:43.514032 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d1a4d7-f224-42c5-b702-3530ed64f769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:43.514845 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d1a4d7-f224-42c5-b702-3530ed64f769 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:43.515135 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d1a4d7-f224-42c5-b702-3530ed64f769 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:43.515414 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d1a4d7-f224-42c5-b702-3530ed64f769 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:43.525355 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d1a4d7-f224-42c5-b702-3530ed64f769 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:36:43.533051 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-a2d1a4d7-f224-42c5-b702-3530ed64f769 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 20:36:43.533051 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:36:43.533051 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:36:43.533051 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:36:43.533051 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:36:43.533051 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:36:43.533051 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:36:43.533051 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:36:43.533051 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:36:43.533051 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:36:43.533051 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:36:43.533051 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:36:43.533051 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:36:43.533051 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:36:43.533051 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:36:43.533051 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:36:43.533907 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:36:43.533907 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:36:43.533907 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:36:43.533907 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:36:43.533907 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:36:43.533907 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:36:43.533907 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:36:43.533907 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:36:43.533907 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:36:43.533907 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:36:43.533907 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:36:43.533907 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:36:43.533907 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:36:43.533907 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:36:43.533907 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:36:43.533907 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:36:43.539987 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:36:43.539987 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:36:43.539987 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:36:43.539987 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:36:43.539987 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:36:43.539987 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:36:43.539987 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:36:43.539987 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:36:43.539987 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:36:43.539987 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:36:43.539987 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 20:36:43.539987 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:36:43.540569 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 35/75] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jul 15 20:36:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 20:36:43.540637 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 41/76] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jul 15 20:36:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:36:43.540697 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e1ecc-c3dc-4844-8fca-a20485b5e51a None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:43.540760 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d1a4d7-f224-42c5-b702-3530ed64f769 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:43.540821 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e1ecc-c3dc-4844-8fca-a20485b5e51a None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:43.540821 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e1ecc-c3dc-4844-8fca-a20485b5e51a None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:43.540821 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 36/77] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:36:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:36:43.540821 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f116e2-a194-4fff-9f44-77294d3a9863 None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:43.540821 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f116e2-a194-4fff-9f44-77294d3a9863 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:43.540821 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f116e2-a194-4fff-9f44-77294d3a9863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:43.554717 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-d6f116e2-a194-4fff-9f44-77294d3a9863 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:43.555922 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-d6f116e2-a194-4fff-9f44-77294d3a9863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:43.628244 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 37/78] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:36:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:36:43.629176 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f116e2-a194-4fff-9f44-77294d3a9863 None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:43.646763 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d1a4d7-f224-42c5-b702-3530ed64f769 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:43.680810 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136e53b9-1c68-4913-8e26-0acbf38777a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:43.681490 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136e53b9-1c68-4913-8e26-0acbf38777a9 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:43.681775 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136e53b9-1c68-4913-8e26-0acbf38777a9 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:43.682050 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136e53b9-1c68-4913-8e26-0acbf38777a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:43.694863 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:43.711012 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:43.729264 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f116e2-a194-4fff-9f44-77294d3a9863 None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:43.752760 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136e53b9-1c68-4913-8e26-0acbf38777a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:43.754267 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136e53b9-1c68-4913-8e26-0acbf38777a9 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:43.763027 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b146c-8d7b-4e5c-818b-2aeffcda8f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:43.763890 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b146c-8d7b-4e5c-818b-2aeffcda8f24 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:43.764185 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b146c-8d7b-4e5c-818b-2aeffcda8f24 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:43.764470 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b146c-8d7b-4e5c-818b-2aeffcda8f24 None admin] PATH_INFO: `/v3/projects/ce682a869504492d931a06b90986fa49` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:43.765673 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8b146c-8d7b-4e5c-818b-2aeffcda8f24 None admin] RBAC: Authorizing `identity:get_project(project_id=ce682a869504492d931a06b90986fa49)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:43.767730 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8b146c-8d7b-4e5c-818b-2aeffcda8f24 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:43.769429 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 38/79] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jul 15 20:36:43 2022] GET /identity/v3/projects/ce682a869504492d931a06b90986fa49 => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:36:43.770218 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b146c-8d7b-4e5c-818b-2aeffcda8f24 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:43.864006 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 42/80] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jul 15 20:36:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 20:36:43.865314 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23644bc7-de86-4ece-82c0-7f0c676fee0a None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:43.865625 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23644bc7-de86-4ece-82c0-7f0c676fee0a None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:43.865895 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23644bc7-de86-4ece-82c0-7f0c676fee0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:43.871843 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b146c-8d7b-4e5c-818b-2aeffcda8f24 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:43.882186 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-23644bc7-de86-4ece-82c0-7f0c676fee0a None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:43.883450 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-23644bc7-de86-4ece-82c0-7f0c676fee0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:43.912357 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a121db05-dbbf-48b1-b347-9441e4459177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:43.913039 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a121db05-dbbf-48b1-b347-9441e4459177 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:43.913343 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a121db05-dbbf-48b1-b347-9441e4459177 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:43.913627 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a121db05-dbbf-48b1-b347-9441e4459177 None admin] PATH_INFO: `/v3/roles` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:43.914419 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a121db05-dbbf-48b1-b347-9441e4459177 None admin] RBAC: Adding query filter params (name=member) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:36:43.914735 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a121db05-dbbf-48b1-b347-9441e4459177 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:43.916136 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a121db05-dbbf-48b1-b347-9441e4459177 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:43.918649 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:43.925810 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 39/81] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Jul 15 20:36:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:36:43.926649 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a121db05-dbbf-48b1-b347-9441e4459177 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:43.947777 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:43.960515 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 43/82] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:36:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:36:43.961337 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23644bc7-de86-4ece-82c0-7f0c676fee0a None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:44.026823 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a121db05-dbbf-48b1-b347-9441e4459177 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:44.060248 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd024b4-1dfb-4651-861c-0ae92dddfd3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:44.060411 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23644bc7-de86-4ece-82c0-7f0c676fee0a None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:44.061046 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd024b4-1dfb-4651-861c-0ae92dddfd3a None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:44.061340 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd024b4-1dfb-4651-861c-0ae92dddfd3a None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:44.061634 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd024b4-1dfb-4651-861c-0ae92dddfd3a None admin] PATH_INFO: `/v3/domains/default` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:44.062922 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd024b4-1dfb-4651-861c-0ae92dddfd3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:44.064298 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd024b4-1dfb-4651-861c-0ae92dddfd3a None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:44.065906 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 40/83] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jul 15 20:36:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:36:44.066703 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd024b4-1dfb-4651-861c-0ae92dddfd3a None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:44.094743 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57821a42-3c1f-4910-89a5-78f3ec92b043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:44.095396 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57821a42-3c1f-4910-89a5-78f3ec92b043 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:44.095682 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57821a42-3c1f-4910-89a5-78f3ec92b043 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:44.095962 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57821a42-3c1f-4910-89a5-78f3ec92b043 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:44.096785 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57821a42-3c1f-4910-89a5-78f3ec92b043 None admin] RBAC: Adding query filter params (role.id=478906d6337444e68ea74da908d9a24d, scope.project.id=ce682a869504492d931a06b90986fa49, user.id=bbd59331bbaf47468ccbb663718c3841) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:36:44.097101 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57821a42-3c1f-4910-89a5-78f3ec92b043 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:44.098596 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57821a42-3c1f-4910-89a5-78f3ec92b043 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:44.103856 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 44/84] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jul 15 20:36:43 2022] GET /identity/v3/role_assignments?user.id=bbd59331bbaf47468ccbb663718c3841&scope.project.id=ce682a869504492d931a06b90986fa49&role.id=478906d6337444e68ea74da908d9a24d => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:36:44.104629 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57821a42-3c1f-4910-89a5-78f3ec92b043 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:44.133921 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:44.183424 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd024b4-1dfb-4651-861c-0ae92dddfd3a None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:44.183625 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:44.223719 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df82bd32-4144-4bb7-bcdd-faa579e358d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:44.224605 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df82bd32-4144-4bb7-bcdd-faa579e358d2 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:44.224899 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df82bd32-4144-4bb7-bcdd-faa579e358d2 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:44.225192 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df82bd32-4144-4bb7-bcdd-faa579e358d2 None admin] PATH_INFO: `/v3/projects/ce682a869504492d931a06b90986fa49` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:44.226494 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df82bd32-4144-4bb7-bcdd-faa579e358d2 None admin] RBAC: Authorizing `identity:get_project(project_id=ce682a869504492d931a06b90986fa49)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:44.227959 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df82bd32-4144-4bb7-bcdd-faa579e358d2 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:44.229775 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 41/85] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jul 15 20:36:44 2022] GET /identity/v3/projects/ce682a869504492d931a06b90986fa49 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:36:44.230615 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df82bd32-4144-4bb7-bcdd-faa579e358d2 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:44.249527 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57821a42-3c1f-4910-89a5-78f3ec92b043 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:44.288516 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66dda42-cbbf-452b-b6c4-4127534c4bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:44.289306 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66dda42-cbbf-452b-b6c4-4127534c4bd8 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:44.289592 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66dda42-cbbf-452b-b6c4-4127534c4bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:44.289870 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66dda42-cbbf-452b-b6c4-4127534c4bd8 None admin] PATH_INFO: `/v3/users/bbd59331bbaf47468ccbb663718c3841` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:44.291122 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66dda42-cbbf-452b-b6c4-4127534c4bd8 None admin] RBAC: Authorizing `identity:get_user(user_id=bbd59331bbaf47468ccbb663718c3841)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:44.292606 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66dda42-cbbf-452b-b6c4-4127534c4bd8 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:44.299668 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 45/86] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jul 15 20:36:44 2022] GET /identity/v3/users/bbd59331bbaf47468ccbb663718c3841 => generated 275 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:36:44.299668 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66dda42-cbbf-452b-b6c4-4127534c4bd8 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:44.350055 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df82bd32-4144-4bb7-bcdd-faa579e358d2 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:44.386394 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6416b19b-3fbe-4060-926a-80a1e27a16bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:44.387223 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6416b19b-3fbe-4060-926a-80a1e27a16bc None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:44.387517 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6416b19b-3fbe-4060-926a-80a1e27a16bc None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:44.387795 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6416b19b-3fbe-4060-926a-80a1e27a16bc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:44.389892 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:44.400265 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6416b19b-3fbe-4060-926a-80a1e27a16bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:36:44.404664 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66dda42-cbbf-452b-b6c4-4127534c4bd8 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:44.409025 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-6416b19b-3fbe-4060-926a-80a1e27a16bc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 20:36:44.409025 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:36:44.409025 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:36:44.409025 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:36:44.409025 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:36:44.409025 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:36:44.409025 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:36:44.409025 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:36:44.409025 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:36:44.409025 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:36:44.409025 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:36:44.409025 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:36:44.409025 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:36:44.409025 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:36:44.409025 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:36:44.409025 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:36:44.409900 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:36:44.409900 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:36:44.409900 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:36:44.409900 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:36:44.409900 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:36:44.409900 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:36:44.409900 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:36:44.409900 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:36:44.409900 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:36:44.409900 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:36:44.409900 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:36:44.409900 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:36:44.409900 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:36:44.409900 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:36:44.409900 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:36:44.409900 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:36:44.410672 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:36:44.410672 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:36:44.410672 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:36:44.410672 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:36:44.410672 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:36:44.410672 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:36:44.410672 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:36:44.410672 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:36:44.410672 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:36:44.410672 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:36:44.410672 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 20:36:44.410672 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:36:44.410672 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 42/87] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Jul 15 20:36:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:36:44.411310 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6416b19b-3fbe-4060-926a-80a1e27a16bc None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:44.429474 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:44.441774 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9b28ae-0211-4a67-bcb7-d3f6acc1a15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:44.442480 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b28ae-0211-4a67-bcb7-d3f6acc1a15c None admin] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:44.442770 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b28ae-0211-4a67-bcb7-d3f6acc1a15c None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:44.443056 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b28ae-0211-4a67-bcb7-d3f6acc1a15c None admin] PATH_INFO: `/v3/users` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:44.443764 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9b28ae-0211-4a67-bcb7-d3f6acc1a15c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:44.445535 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9b28ae-0211-4a67-bcb7-d3f6acc1a15c None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:44.468852 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 46/88] 10.222.0.16 () {60 vars in 1132 bytes} [Fri Jul 15 20:36:44 2022] POST /identity/v3/users => generated 289 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:36:44.475832 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9b28ae-0211-4a67-bcb7-d3f6acc1a15c None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:44.554638 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6416b19b-3fbe-4060-926a-80a1e27a16bc None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:44.596933 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e656f29-39e4-4e38-92e7-08aa8c66595d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:44.597611 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e656f29-39e4-4e38-92e7-08aa8c66595d None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:44.597909 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e656f29-39e4-4e38-92e7-08aa8c66595d None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:44.598243 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e656f29-39e4-4e38-92e7-08aa8c66595d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:44.599210 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e656f29-39e4-4e38-92e7-08aa8c66595d None admin] RBAC: Adding query filter params (role.id=cbcae224848142ce888ca5b84abfd18e, scope.project.id=ce682a869504492d931a06b90986fa49, user.id=904f3e39010c4ee1ad10cdd271b0b153) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:36:44.599537 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e656f29-39e4-4e38-92e7-08aa8c66595d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:44.601175 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e656f29-39e4-4e38-92e7-08aa8c66595d None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:44.607930 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 43/89] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jul 15 20:36:44 2022] GET /identity/v3/role_assignments?user.id=904f3e39010c4ee1ad10cdd271b0b153&scope.project.id=ce682a869504492d931a06b90986fa49&role.id=cbcae224848142ce888ca5b84abfd18e => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:36:44.614432 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e656f29-39e4-4e38-92e7-08aa8c66595d None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:44.621505 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9b28ae-0211-4a67-bcb7-d3f6acc1a15c None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:44.702857 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd982183-ac54-47b4-b939-bbecafb58041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:44.704098 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd982183-ac54-47b4-b939-bbecafb58041 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:44.704392 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd982183-ac54-47b4-b939-bbecafb58041 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:44.704678 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd982183-ac54-47b4-b939-bbecafb58041 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:44.726852 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:44.774496 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:44.785348 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e656f29-39e4-4e38-92e7-08aa8c66595d None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:44.795449 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd982183-ac54-47b4-b939-bbecafb58041 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:44.797698 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd982183-ac54-47b4-b939-bbecafb58041 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:44.823124 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba11d25c-5daf-4aaf-970a-abce1dde7847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:44.823708 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba11d25c-5daf-4aaf-970a-abce1dde7847 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:44.824002 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba11d25c-5daf-4aaf-970a-abce1dde7847 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:44.824288 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba11d25c-5daf-4aaf-970a-abce1dde7847 None admin] PATH_INFO: `/v3/roles` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:44.825056 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba11d25c-5daf-4aaf-970a-abce1dde7847 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:36:44.825366 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba11d25c-5daf-4aaf-970a-abce1dde7847 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:44.828008 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba11d25c-5daf-4aaf-970a-abce1dde7847 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:44.837609 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 44/90] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jul 15 20:36:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:36:44.842918 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba11d25c-5daf-4aaf-970a-abce1dde7847 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:44.928610 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 47/91] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jul 15 20:36:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 20:36:44.936452 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd982183-ac54-47b4-b939-bbecafb58041 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:44.963391 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba11d25c-5daf-4aaf-970a-abce1dde7847 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:44.988097 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:45.013509 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f75171-e22a-4e81-a8d7-6d13f8fd4cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:45.014294 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f75171-e22a-4e81-a8d7-6d13f8fd4cdd None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:45.014588 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f75171-e22a-4e81-a8d7-6d13f8fd4cdd None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:45.014873 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f75171-e22a-4e81-a8d7-6d13f8fd4cdd None admin] PATH_INFO: `/v3/users/bbd59331bbaf47468ccbb663718c3841` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:45.016454 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f75171-e22a-4e81-a8d7-6d13f8fd4cdd None admin] RBAC: Authorizing `identity:get_user(user_id=bbd59331bbaf47468ccbb663718c3841)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:45.018569 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f75171-e22a-4e81-a8d7-6d13f8fd4cdd None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:45.020599 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 45/92] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jul 15 20:36:44 2022] GET /identity/v3/users/bbd59331bbaf47468ccbb663718c3841 => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:36:45.027718 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f75171-e22a-4e81-a8d7-6d13f8fd4cdd None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:45.046480 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:45.074567 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd982183-ac54-47b4-b939-bbecafb58041 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:45.119631 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25d272f-6620-4829-b48d-37e5dae4e439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:45.121818 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25d272f-6620-4829-b48d-37e5dae4e439 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:45.122631 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25d272f-6620-4829-b48d-37e5dae4e439 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:45.123110 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25d272f-6620-4829-b48d-37e5dae4e439 None admin] PATH_INFO: `/v3/projects/48e9b39bc1aa4bc393c66659e84a6690` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:45.126349 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25d272f-6620-4829-b48d-37e5dae4e439 None admin] RBAC: Authorizing `identity:get_project(project_id=48e9b39bc1aa4bc393c66659e84a6690)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:45.128024 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25d272f-6620-4829-b48d-37e5dae4e439 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:45.129993 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 48/93] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jul 15 20:36:44 2022] GET /identity/v3/projects/48e9b39bc1aa4bc393c66659e84a6690 => generated 312 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:36:45.138957 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25d272f-6620-4829-b48d-37e5dae4e439 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:45.163400 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f75171-e22a-4e81-a8d7-6d13f8fd4cdd None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:45.216955 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb538104-a44b-406e-a465-7af98b202973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:45.217712 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb538104-a44b-406e-a465-7af98b202973 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:45.217998 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb538104-a44b-406e-a465-7af98b202973 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:45.218314 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb538104-a44b-406e-a465-7af98b202973 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:45.269203 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25d272f-6620-4829-b48d-37e5dae4e439 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:45.294619 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:45.307686 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf58a59-3cec-4f92-95d5-f6bb0acc2637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:45.308955 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf58a59-3cec-4f92-95d5-f6bb0acc2637 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:45.309438 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb538104-a44b-406e-a465-7af98b202973 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:45.309670 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf58a59-3cec-4f92-95d5-f6bb0acc2637 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:45.310163 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf58a59-3cec-4f92-95d5-f6bb0acc2637 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:45.310970 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb538104-a44b-406e-a465-7af98b202973 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:45.311392 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf58a59-3cec-4f92-95d5-f6bb0acc2637 None admin] RBAC: Adding query filter params (role.id=478906d6337444e68ea74da908d9a24d, scope.project.id=48e9b39bc1aa4bc393c66659e84a6690, user.id=bbd59331bbaf47468ccbb663718c3841) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:36:45.311911 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf58a59-3cec-4f92-95d5-f6bb0acc2637 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:45.315446 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf58a59-3cec-4f92-95d5-f6bb0acc2637 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:45.322776 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 49/94] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jul 15 20:36:45 2022] GET /identity/v3/role_assignments?user.id=bbd59331bbaf47468ccbb663718c3841&scope.project.id=48e9b39bc1aa4bc393c66659e84a6690&role.id=478906d6337444e68ea74da908d9a24d => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:36:45.440539 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 46/95] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jul 15 20:36:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 15 20:36:45.446451 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf58a59-3cec-4f92-95d5-f6bb0acc2637 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:45.477210 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:45.603554 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf58a59-3cec-4f92-95d5-f6bb0acc2637 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:45.646745 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec282385-3dc5-470a-a8e5-5c7faa242875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:45.647619 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec282385-3dc5-470a-a8e5-5c7faa242875 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:45.647918 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec282385-3dc5-470a-a8e5-5c7faa242875 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:45.648206 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec282385-3dc5-470a-a8e5-5c7faa242875 None admin] PATH_INFO: `/v3/projects/ce682a869504492d931a06b90986fa49` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:45.649420 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec282385-3dc5-470a-a8e5-5c7faa242875 None admin] RBAC: Authorizing `identity:get_project(project_id=ce682a869504492d931a06b90986fa49)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:45.650957 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec282385-3dc5-470a-a8e5-5c7faa242875 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:45.652860 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 50/96] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jul 15 20:36:45 2022] GET /identity/v3/projects/ce682a869504492d931a06b90986fa49 => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:36:45.659342 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb538104-a44b-406e-a465-7af98b202973 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:45.763887 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:45.797852 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb538104-a44b-406e-a465-7af98b202973 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:45.859390 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a596ec1-8fdd-47db-8f36-80ed56462868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:45.860108 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a596ec1-8fdd-47db-8f36-80ed56462868 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:45.860402 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a596ec1-8fdd-47db-8f36-80ed56462868 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:45.860686 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a596ec1-8fdd-47db-8f36-80ed56462868 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:45.861537 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a596ec1-8fdd-47db-8f36-80ed56462868 None admin] RBAC: Adding query filter params (role.id=7deae0ce5d074f488024c63c8ce63928, scope.project.id=ce682a869504492d931a06b90986fa49, user.id=bbd59331bbaf47468ccbb663718c3841) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:36:45.861857 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a596ec1-8fdd-47db-8f36-80ed56462868 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:45.863408 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a596ec1-8fdd-47db-8f36-80ed56462868 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:45.874583 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 47/97] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jul 15 20:36:45 2022] GET /identity/v3/role_assignments?user.id=bbd59331bbaf47468ccbb663718c3841&scope.project.id=ce682a869504492d931a06b90986fa49&role.id=7deae0ce5d074f488024c63c8ce63928 => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:36:47.454878 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ddb75-7008-497b-b149-48be413d94a3 None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:47.455882 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ddb75-7008-497b-b149-48be413d94a3 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:47.456379 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ddb75-7008-497b-b149-48be413d94a3 None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:47.463097 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 51/98] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:36:47 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:36:47.464911 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57708251-016e-4ef3-a3bd-fa4d1ea5c169 None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:47.465721 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57708251-016e-4ef3-a3bd-fa4d1ea5c169 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:47.466275 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57708251-016e-4ef3-a3bd-fa4d1ea5c169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:47.491191 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-57708251-016e-4ef3-a3bd-fa4d1ea5c169 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:47.492430 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-57708251-016e-4ef3-a3bd-fa4d1ea5c169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:47.525211 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db8cd0b-d0c6-4bd3-ba5b-5ad502f327ff None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:47.525517 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db8cd0b-d0c6-4bd3-ba5b-5ad502f327ff None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:47.525793 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db8cd0b-d0c6-4bd3-ba5b-5ad502f327ff None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:47.527323 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 52/99] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:36:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:36:47.533086 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3710a80b-1bb9-47d1-9a50-8d631be30721 None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:47.533388 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3710a80b-1bb9-47d1-9a50-8d631be30721 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:47.533684 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3710a80b-1bb9-47d1-9a50-8d631be30721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:47.567204 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-3710a80b-1bb9-47d1-9a50-8d631be30721 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:47.567867 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 48/100] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:36:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:36:47.569693 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-3710a80b-1bb9-47d1-9a50-8d631be30721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:47.592174 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57708251-016e-4ef3-a3bd-fa4d1ea5c169 None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:47.692108 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 53/101] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:36:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:36:47.727506 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3710a80b-1bb9-47d1-9a50-8d631be30721 None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:47.730947 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:47.742492 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:47.748340 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57708251-016e-4ef3-a3bd-fa4d1ea5c169 None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:47.807123 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d876ba31-2644-4567-9e4d-1b446af52cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:47.807945 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d876ba31-2644-4567-9e4d-1b446af52cf9 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:47.808244 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d876ba31-2644-4567-9e4d-1b446af52cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:47.808678 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d876ba31-2644-4567-9e4d-1b446af52cf9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:47.833722 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d876ba31-2644-4567-9e4d-1b446af52cf9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:36:47.848980 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-d876ba31-2644-4567-9e4d-1b446af52cf9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 20:36:47.848980 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:36:47.848980 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:36:47.848980 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:36:47.848980 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:36:47.848980 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:36:47.848980 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:36:47.848980 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:36:47.848980 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:36:47.848980 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:36:47.848980 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:36:47.848980 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:36:47.848980 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:36:47.848980 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:36:47.848980 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:36:47.848980 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:36:47.849827 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:36:47.849827 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:36:47.849827 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:36:47.849827 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:36:47.849827 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:36:47.849827 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:36:47.849827 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:36:47.849827 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:36:47.849827 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:36:47.849827 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:36:47.849827 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:36:47.849827 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:36:47.849827 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:36:47.849827 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:36:47.849827 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:36:47.849827 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:36:47.850599 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:36:47.850599 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:36:47.850599 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:36:47.850599 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:36:47.850599 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:36:47.850599 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:36:47.850599 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:36:47.850599 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:36:47.850599 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:36:47.850599 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:36:47.850599 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 20:36:47.850599 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:36:47.851149 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 49/102] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jul 15 20:36:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 20:36:47.863247 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d876ba31-2644-4567-9e4d-1b446af52cf9 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:47.926517 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3710a80b-1bb9-47d1-9a50-8d631be30721 None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:47.997811 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e100a8c-23fb-45d1-ad5d-45f8500b38b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:47.999747 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d876ba31-2644-4567-9e4d-1b446af52cf9 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:48.001632 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e100a8c-23fb-45d1-ad5d-45f8500b38b0 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:48.002223 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e100a8c-23fb-45d1-ad5d-45f8500b38b0 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:48.002829 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e100a8c-23fb-45d1-ad5d-45f8500b38b0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:48.025120 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e100a8c-23fb-45d1-ad5d-45f8500b38b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:36:48.039672 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-8e100a8c-23fb-45d1-ad5d-45f8500b38b0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:36:48.039672 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:36:48.039672 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:36:48.039672 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:36:48.039672 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:36:48.039672 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:36:48.039672 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:36:48.039672 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:36:48.039672 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:36:48.039672 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:36:48.039672 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:36:48.039672 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:36:48.039672 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:36:48.039672 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:36:48.039672 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:36:48.039672 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:36:48.040512 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:36:48.040512 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:36:48.040512 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:36:48.040512 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:36:48.040512 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:36:48.040512 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:36:48.040512 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:36:48.040512 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:36:48.040512 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:36:48.040512 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:36:48.040512 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:36:48.040512 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:36:48.040512 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:36:48.040512 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:36:48.040512 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:36:48.040512 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:36:48.041243 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:36:48.041243 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:36:48.041243 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:36:48.041243 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:36:48.041243 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:36:48.041243 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:36:48.041243 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:36:48.041243 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:36:48.041243 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:36:48.041243 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:36:48.041243 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:36:48.041243 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:36:48.041243 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 54/103] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Jul 15 20:36:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 20:36:48.045444 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6edfd9a-0a94-4fca-bbe0-349d0e7acb35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:48.046162 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6edfd9a-0a94-4fca-bbe0-349d0e7acb35 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:48.046465 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6edfd9a-0a94-4fca-bbe0-349d0e7acb35 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:48.046752 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6edfd9a-0a94-4fca-bbe0-349d0e7acb35 None admin] PATH_INFO: `/v3/roles` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:48.047546 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6edfd9a-0a94-4fca-bbe0-349d0e7acb35 None admin] RBAC: Adding query filter params (name=member) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:36:48.047868 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6edfd9a-0a94-4fca-bbe0-349d0e7acb35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:48.049411 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e100a8c-23fb-45d1-ad5d-45f8500b38b0 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:48.050643 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6edfd9a-0a94-4fca-bbe0-349d0e7acb35 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:48.068615 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 50/104] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Jul 15 20:36:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:36:48.074274 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6edfd9a-0a94-4fca-bbe0-349d0e7acb35 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:48.090426 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:48.201653 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:48.231043 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6edfd9a-0a94-4fca-bbe0-349d0e7acb35 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:48.276358 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23a9ff4-27ac-41c9-a597-f9835dff4691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:48.277172 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a9ff4-27ac-41c9-a597-f9835dff4691 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:48.277477 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a9ff4-27ac-41c9-a597-f9835dff4691 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:48.277765 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a9ff4-27ac-41c9-a597-f9835dff4691 None admin] PATH_INFO: `/v3/users/bbd59331bbaf47468ccbb663718c3841` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:48.279036 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23a9ff4-27ac-41c9-a597-f9835dff4691 None admin] RBAC: Authorizing `identity:get_user(user_id=bbd59331bbaf47468ccbb663718c3841)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:48.280497 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23a9ff4-27ac-41c9-a597-f9835dff4691 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:48.282531 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 51/105] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jul 15 20:36:48 2022] GET /identity/v3/users/bbd59331bbaf47468ccbb663718c3841 => generated 275 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:36:48.291377 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23a9ff4-27ac-41c9-a597-f9835dff4691 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:48.294300 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e100a8c-23fb-45d1-ad5d-45f8500b38b0 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:48.357256 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b280dc4-23c9-4b03-96c7-0330bce3e1b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:48.357971 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b280dc4-23c9-4b03-96c7-0330bce3e1b5 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:48.358370 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b280dc4-23c9-4b03-96c7-0330bce3e1b5 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:48.358660 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b280dc4-23c9-4b03-96c7-0330bce3e1b5 None admin] PATH_INFO: `/v3/roles` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:48.359424 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b280dc4-23c9-4b03-96c7-0330bce3e1b5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:36:48.359809 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b280dc4-23c9-4b03-96c7-0330bce3e1b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:48.361249 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b280dc4-23c9-4b03-96c7-0330bce3e1b5 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:48.380655 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 55/106] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jul 15 20:36:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:36:48.386786 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b280dc4-23c9-4b03-96c7-0330bce3e1b5 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:48.433327 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:48.490223 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23a9ff4-27ac-41c9-a597-f9835dff4691 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:48.557774 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f23038-34ec-4492-b78e-857ff09dadf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:48.559346 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f23038-34ec-4492-b78e-857ff09dadf3 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:48.559839 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f23038-34ec-4492-b78e-857ff09dadf3 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:48.560400 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f23038-34ec-4492-b78e-857ff09dadf3 None admin] PATH_INFO: `/v3/projects/ce682a869504492d931a06b90986fa49` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:48.561855 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f23038-34ec-4492-b78e-857ff09dadf3 None admin] RBAC: Authorizing `identity:get_project(project_id=ce682a869504492d931a06b90986fa49)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:48.564087 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f23038-34ec-4492-b78e-857ff09dadf3 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:48.566014 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 52/107] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jul 15 20:36:48 2022] GET /identity/v3/projects/ce682a869504492d931a06b90986fa49 => generated 298 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:36:48.567498 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f83548-9194-4e7c-a763-effd48d77d55 None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:48.568005 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f83548-9194-4e7c-a763-effd48d77d55 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:48.568495 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f83548-9194-4e7c-a763-effd48d77d55 None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:48.570462 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 53/108] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:36:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:36:48.574128 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b280dc4-23c9-4b03-96c7-0330bce3e1b5 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:48.576784 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d8f791-02d0-45ae-81b4-b598e4ba5d55 None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:48.577306 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d8f791-02d0-45ae-81b4-b598e4ba5d55 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:48.577794 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d8f791-02d0-45ae-81b4-b598e4ba5d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:48.601580 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-c0d8f791-02d0-45ae-81b4-b598e4ba5d55 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:48.603344 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-c0d8f791-02d0-45ae-81b4-b598e4ba5d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:48.619675 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:48.626472 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7842141f-4e04-4f7c-a340-29c55a2d2684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:48.627715 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7842141f-4e04-4f7c-a340-29c55a2d2684 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:48.628368 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7842141f-4e04-4f7c-a340-29c55a2d2684 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:48.628789 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7842141f-4e04-4f7c-a340-29c55a2d2684 None admin] PATH_INFO: `/v3/users/904f3e39010c4ee1ad10cdd271b0b153` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:48.630193 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7842141f-4e04-4f7c-a340-29c55a2d2684 None admin] RBAC: Authorizing `identity:get_user(user_id=904f3e39010c4ee1ad10cdd271b0b153)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:48.632050 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7842141f-4e04-4f7c-a340-29c55a2d2684 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:48.633979 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 56/109] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jul 15 20:36:48 2022] GET /identity/v3/users/904f3e39010c4ee1ad10cdd271b0b153 => generated 247 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:36:48.635127 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7842141f-4e04-4f7c-a340-29c55a2d2684 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:48.682938 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 54/110] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:36:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 20:36:48.684446 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37901a3-56a3-4db5-8119-a6985f99ec23 None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:48.690633 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37901a3-56a3-4db5-8119-a6985f99ec23 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:48.691033 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37901a3-56a3-4db5-8119-a6985f99ec23 None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:48.692481 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 55/111] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:36:48 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:36:48.696874 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37901a3-56a3-4db5-8119-a6985f99ec23 None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:48.752790 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7842141f-4e04-4f7c-a340-29c55a2d2684 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:48.794040 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeece27-bd87-4ff5-a6dd-5315b1caed21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:48.795163 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeece27-bd87-4ff5-a6dd-5315b1caed21 None admin] REQUEST_METHOD: `PUT` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:48.795559 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeece27-bd87-4ff5-a6dd-5315b1caed21 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:48.795947 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeece27-bd87-4ff5-a6dd-5315b1caed21 None admin] PATH_INFO: `/v3/projects/ce682a869504492d931a06b90986fa49/users/bbd59331bbaf47468ccbb663718c3841/roles/478906d6337444e68ea74da908d9a24d` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:48.797446 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:48.798680 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeece27-bd87-4ff5-a6dd-5315b1caed21 None admin] RBAC: Authorizing `identity:create_grant(project_id=ce682a869504492d931a06b90986fa49, user_id=bbd59331bbaf47468ccbb663718c3841, role_id=478906d6337444e68ea74da908d9a24d)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:48.800278 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeece27-bd87-4ff5-a6dd-5315b1caed21 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:48.817620 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 57/112] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Jul 15 20:36:48 2022] PUT /identity/v3/projects/ce682a869504492d931a06b90986fa49/users/bbd59331bbaf47468ccbb663718c3841/roles/478906d6337444e68ea74da908d9a24d => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:36:48.819229 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20203d7d-86ad-4f05-ae2d-a3e47e2efbc1 None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:48.820270 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20203d7d-86ad-4f05-ae2d-a3e47e2efbc1 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:48.820664 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20203d7d-86ad-4f05-ae2d-a3e47e2efbc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:48.850890 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-20203d7d-86ad-4f05-ae2d-a3e47e2efbc1 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:48.852146 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-20203d7d-86ad-4f05-ae2d-a3e47e2efbc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:48.866967 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37901a3-56a3-4db5-8119-a6985f99ec23 None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:48.929689 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:48.942405 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937113b2-4fc7-47c7-b06f-3e9db546eeb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:48.943242 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937113b2-4fc7-47c7-b06f-3e9db546eeb1 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:48.943577 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937113b2-4fc7-47c7-b06f-3e9db546eeb1 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:48.943871 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937113b2-4fc7-47c7-b06f-3e9db546eeb1 None admin] PATH_INFO: `/v3/projects/ce682a869504492d931a06b90986fa49` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:48.948009 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937113b2-4fc7-47c7-b06f-3e9db546eeb1 None admin] RBAC: Authorizing `identity:get_project(project_id=ce682a869504492d931a06b90986fa49)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:48.949549 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937113b2-4fc7-47c7-b06f-3e9db546eeb1 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:48.951599 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 56/113] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jul 15 20:36:48 2022] GET /identity/v3/projects/ce682a869504492d931a06b90986fa49 => generated 298 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:36:48.952263 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937113b2-4fc7-47c7-b06f-3e9db546eeb1 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:48.952633 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 58/114] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:36:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:36:48.959458 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20203d7d-86ad-4f05-ae2d-a3e47e2efbc1 None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:49.096229 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20203d7d-86ad-4f05-ae2d-a3e47e2efbc1 None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:49.116413 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937113b2-4fc7-47c7-b06f-3e9db546eeb1 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:49.141308 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a228bd-e095-464c-bdcd-f9bb984e780a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:49.142246 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a228bd-e095-464c-bdcd-f9bb984e780a None admin] REQUEST_METHOD: `PUT` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:49.142538 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a228bd-e095-464c-bdcd-f9bb984e780a None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:49.142820 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a228bd-e095-464c-bdcd-f9bb984e780a None admin] PATH_INFO: `/v3/projects/ce682a869504492d931a06b90986fa49/users/904f3e39010c4ee1ad10cdd271b0b153/roles/cbcae224848142ce888ca5b84abfd18e` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:49.145645 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a228bd-e095-464c-bdcd-f9bb984e780a None admin] RBAC: Authorizing `identity:create_grant(project_id=ce682a869504492d931a06b90986fa49, user_id=904f3e39010c4ee1ad10cdd271b0b153, role_id=cbcae224848142ce888ca5b84abfd18e)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:49.147130 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a228bd-e095-464c-bdcd-f9bb984e780a None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:49.161821 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 59/115] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Jul 15 20:36:48 2022] PUT /identity/v3/projects/ce682a869504492d931a06b90986fa49/users/904f3e39010c4ee1ad10cdd271b0b153/roles/cbcae224848142ce888ca5b84abfd18e => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:36:49.162952 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0743527d-83be-4ff4-b782-3edb7ef3258f None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:49.163250 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0743527d-83be-4ff4-b782-3edb7ef3258f None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:49.163535 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0743527d-83be-4ff4-b782-3edb7ef3258f None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:49.164812 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 60/116] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:36:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:36:49.166931 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0743527d-83be-4ff4-b782-3edb7ef3258f None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:49.169432 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980c4710-8c2b-4e9d-a9ce-594a8e665c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:49.171058 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c4710-8c2b-4e9d-a9ce-594a8e665c00 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:49.171372 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c4710-8c2b-4e9d-a9ce-594a8e665c00 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:49.171683 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c4710-8c2b-4e9d-a9ce-594a8e665c00 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:49.173869 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980c4710-8c2b-4e9d-a9ce-594a8e665c00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:49.176533 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980c4710-8c2b-4e9d-a9ce-594a8e665c00 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:49.178654 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 57/117] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jul 15 20:36:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:36:49.185276 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648020f-a073-483f-a70d-a0dfecb92035 None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:49.185601 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648020f-a073-483f-a70d-a0dfecb92035 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:49.185851 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648020f-a073-483f-a70d-a0dfecb92035 None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:49.187995 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 58/118] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:36:49 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:36:49.191652 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9337066-5994-48c1-8c0b-34d432ce49d9 None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:49.192700 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9337066-5994-48c1-8c0b-34d432ce49d9 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:49.194124 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9337066-5994-48c1-8c0b-34d432ce49d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:49.212679 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:49.221784 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-f9337066-5994-48c1-8c0b-34d432ce49d9 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:49.224315 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-f9337066-5994-48c1-8c0b-34d432ce49d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:49.270505 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:49.308447 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 59/119] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:36:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:36:49.309801 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9337066-5994-48c1-8c0b-34d432ce49d9 None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:49.359399 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0743527d-83be-4ff4-b782-3edb7ef3258f None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:49.410100 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7bf820-45ea-4194-a758-eb2d10d58a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:49.410100 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7bf820-45ea-4194-a758-eb2d10d58a4c None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:49.410100 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7bf820-45ea-4194-a758-eb2d10d58a4c None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:49.410100 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7bf820-45ea-4194-a758-eb2d10d58a4c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:49.420159 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7bf820-45ea-4194-a758-eb2d10d58a4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:36:49.430264 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-ea7bf820-45ea-4194-a758-eb2d10d58a4c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 20:36:49.430264 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:36:49.430264 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:36:49.430264 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:36:49.430264 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:36:49.430264 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:36:49.430264 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:36:49.430264 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:36:49.430264 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:36:49.430264 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:36:49.430264 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:36:49.430264 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:36:49.430264 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:36:49.430264 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:36:49.430264 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:36:49.430264 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:36:49.431169 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:36:49.431169 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:36:49.431169 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:36:49.431169 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:36:49.431169 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:36:49.431169 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:36:49.431169 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:36:49.431169 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:36:49.431169 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:36:49.431169 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:36:49.431169 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:36:49.431169 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:36:49.431169 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:36:49.431169 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:36:49.431169 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:36:49.431169 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:36:49.431936 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:36:49.431936 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:36:49.431936 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:36:49.431936 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:36:49.431936 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:36:49.431936 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:36:49.431936 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:36:49.431936 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:36:49.431936 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:36:49.431936 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:36:49.431936 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 20:36:49.431936 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:36:49.431936 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 61/120] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jul 15 20:36:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:36:49.433330 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e123acda-bc8a-4163-a036-0325f19ba568 None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:49.433330 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e123acda-bc8a-4163-a036-0325f19ba568 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:49.433330 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e123acda-bc8a-4163-a036-0325f19ba568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:49.461206 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-e123acda-bc8a-4163-a036-0325f19ba568 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:49.463101 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-e123acda-bc8a-4163-a036-0325f19ba568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:49.472295 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9337066-5994-48c1-8c0b-34d432ce49d9 None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:49.510338 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9edc6a7-c658-485b-83d0-994e8713e7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:49.511094 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9edc6a7-c658-485b-83d0-994e8713e7e6 None admin] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:49.511304 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9edc6a7-c658-485b-83d0-994e8713e7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:49.511641 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9edc6a7-c658-485b-83d0-994e8713e7e6 None admin] PATH_INFO: `/v3/projects` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:49.512475 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9edc6a7-c658-485b-83d0-994e8713e7e6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:49.514144 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9edc6a7-c658-485b-83d0-994e8713e7e6 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:49.519432 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:49.540682 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 62/121] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:36:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:36:49.541871 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e123acda-bc8a-4163-a036-0325f19ba568 None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:49.559534 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 60/122] 10.222.0.16 () {60 vars in 1141 bytes} [Fri Jul 15 20:36:49 2022] POST /identity/v3/projects => generated 302 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:36:49.563021 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9edc6a7-c658-485b-83d0-994e8713e7e6 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:49.632757 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:49.751981 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e123acda-bc8a-4163-a036-0325f19ba568 None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:49.774848 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9edc6a7-c658-485b-83d0-994e8713e7e6 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:49.818618 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ed2046-186b-4f72-82bd-81599a55763d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:49.819678 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed2046-186b-4f72-82bd-81599a55763d None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:49.819974 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed2046-186b-4f72-82bd-81599a55763d None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:49.820261 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed2046-186b-4f72-82bd-81599a55763d None admin] PATH_INFO: `/v3/roles/member` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:49.835678 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e60362-a8a6-4332-8c48-c8ba31d7c58c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:49.836752 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ed2046-186b-4f72-82bd-81599a55763d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:36:49.837336 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e60362-a8a6-4332-8c48-c8ba31d7c58c None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:49.837965 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e60362-a8a6-4332-8c48-c8ba31d7c58c None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:49.838552 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e60362-a8a6-4332-8c48-c8ba31d7c58c None admin] PATH_INFO: `/v3/roles` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:49.839621 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e60362-a8a6-4332-8c48-c8ba31d7c58c None admin] RBAC: Adding query filter params (name=reader) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:36:49.840082 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e60362-a8a6-4332-8c48-c8ba31d7c58c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:49.841601 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e60362-a8a6-4332-8c48-c8ba31d7c58c None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:49.844823 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-b3ed2046-186b-4f72-82bd-81599a55763d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 20:36:49.844823 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:36:49.844823 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:36:49.844823 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:36:49.844823 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:36:49.844823 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:36:49.844823 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:36:49.844823 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:36:49.844823 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:36:49.844823 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:36:49.844823 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:36:49.844823 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:36:49.844823 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:36:49.844823 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:36:49.844823 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:36:49.844823 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:36:49.845826 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:36:49.845826 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:36:49.845826 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:36:49.845826 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:36:49.845826 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:36:49.845826 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:36:49.845826 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:36:49.845826 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:36:49.845826 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:36:49.845826 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:36:49.845826 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:36:49.845826 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:36:49.845826 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:36:49.845826 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:36:49.845826 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:36:49.845826 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:36:49.847709 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:36:49.847709 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:36:49.847709 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:36:49.847709 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:36:49.847709 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:36:49.847709 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:36:49.847709 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:36:49.847709 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:36:49.847709 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:36:49.847709 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:36:49.847709 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 20:36:49.847709 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:36:49.847709 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 63/123] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jul 15 20:36:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:36:49.847709 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ed2046-186b-4f72-82bd-81599a55763d None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:49.854955 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 61/124] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Jul 15 20:36:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:36:49.856106 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e60362-a8a6-4332-8c48-c8ba31d7c58c None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:49.931193 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:49.989508 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ed2046-186b-4f72-82bd-81599a55763d None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:50.002515 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:50.028548 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637fd752-e4aa-4a67-ada7-00d27cf36bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:50.029841 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637fd752-e4aa-4a67-ada7-00d27cf36bc5 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:50.030329 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637fd752-e4aa-4a67-ada7-00d27cf36bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:50.031209 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637fd752-e4aa-4a67-ada7-00d27cf36bc5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:50.044424 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637fd752-e4aa-4a67-ada7-00d27cf36bc5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:36:50.052180 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e60362-a8a6-4332-8c48-c8ba31d7c58c None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:50.053595 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-637fd752-e4aa-4a67-ada7-00d27cf36bc5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 20:36:50.053595 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:36:50.053595 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:36:50.053595 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:36:50.053595 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:36:50.053595 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:36:50.053595 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:36:50.053595 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:36:50.053595 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:36:50.053595 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:36:50.053595 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:36:50.053595 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:36:50.053595 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:36:50.053595 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:36:50.053595 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:36:50.053595 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:36:50.054642 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:36:50.054642 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:36:50.054642 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:36:50.054642 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:36:50.054642 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:36:50.054642 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:36:50.054642 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:36:50.054642 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:36:50.054642 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:36:50.054642 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:36:50.054642 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:36:50.054642 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:36:50.054642 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:36:50.054642 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:36:50.054642 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:36:50.054642 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:36:50.055590 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:36:50.055590 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:36:50.055590 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:36:50.055590 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:36:50.055590 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:36:50.055590 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:36:50.055590 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:36:50.055590 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:36:50.055590 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:36:50.055590 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:36:50.055590 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 20:36:50.055590 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:36:50.057905 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 64/125] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Jul 15 20:36:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:36:50.060254 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637fd752-e4aa-4a67-ada7-00d27cf36bc5 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:50.165887 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2f5042-d8cc-4968-9bdd-9dbd08c8d969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:50.166605 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2f5042-d8cc-4968-9bdd-9dbd08c8d969 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:50.166958 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2f5042-d8cc-4968-9bdd-9dbd08c8d969 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:50.167301 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2f5042-d8cc-4968-9bdd-9dbd08c8d969 None admin] PATH_INFO: `/v3/roles` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:50.168128 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2f5042-d8cc-4968-9bdd-9dbd08c8d969 None admin] RBAC: Adding query filter params (name=member) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:36:50.168387 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2f5042-d8cc-4968-9bdd-9dbd08c8d969 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:50.169781 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2f5042-d8cc-4968-9bdd-9dbd08c8d969 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:50.173027 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637fd752-e4aa-4a67-ada7-00d27cf36bc5 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:50.191229 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 62/126] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Jul 15 20:36:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:36:50.192024 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2f5042-d8cc-4968-9bdd-9dbd08c8d969 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:50.221211 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f30a79b-c337-4c15-bdca-9972ce0a0ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:50.222442 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30a79b-c337-4c15-bdca-9972ce0a0ea1 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:50.222737 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30a79b-c337-4c15-bdca-9972ce0a0ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:50.223026 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30a79b-c337-4c15-bdca-9972ce0a0ea1 None admin] PATH_INFO: `/v3/users/978d6e4088c54f40980db9bee13bed32` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:50.253056 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f30a79b-c337-4c15-bdca-9972ce0a0ea1 None admin] RBAC: Authorizing `identity:get_user(user_id=978d6e4088c54f40980db9bee13bed32)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:50.255198 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f30a79b-c337-4c15-bdca-9972ce0a0ea1 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:50.256925 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 65/127] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jul 15 20:36:50 2022] GET /identity/v3/users/978d6e4088c54f40980db9bee13bed32 => generated 289 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:36:50.265461 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f30a79b-c337-4c15-bdca-9972ce0a0ea1 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:50.301260 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:50.399090 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f30a79b-c337-4c15-bdca-9972ce0a0ea1 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:50.436598 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd000fb-f50b-4576-bae1-1d7b0616d791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:50.438795 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd000fb-f50b-4576-bae1-1d7b0616d791 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:50.439374 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd000fb-f50b-4576-bae1-1d7b0616d791 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:50.439792 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd000fb-f50b-4576-bae1-1d7b0616d791 None admin] PATH_INFO: `/v3/users/bbd59331bbaf47468ccbb663718c3841` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:50.441142 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2f5042-d8cc-4968-9bdd-9dbd08c8d969 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:50.441472 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd000fb-f50b-4576-bae1-1d7b0616d791 None admin] RBAC: Authorizing `identity:get_user(user_id=bbd59331bbaf47468ccbb663718c3841)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:50.443372 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd000fb-f50b-4576-bae1-1d7b0616d791 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:50.445532 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 66/128] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jul 15 20:36:50 2022] GET /identity/v3/users/bbd59331bbaf47468ccbb663718c3841 => generated 275 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:36:50.446841 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd000fb-f50b-4576-bae1-1d7b0616d791 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:50.484104 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:50.528311 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef73d8a7-a09c-418c-ba7f-f773cf20596b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:50.529143 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef73d8a7-a09c-418c-ba7f-f773cf20596b None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:50.529557 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef73d8a7-a09c-418c-ba7f-f773cf20596b None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:50.529933 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef73d8a7-a09c-418c-ba7f-f773cf20596b None admin] PATH_INFO: `/v3/roles` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:50.530859 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef73d8a7-a09c-418c-ba7f-f773cf20596b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:36:50.531245 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef73d8a7-a09c-418c-ba7f-f773cf20596b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:50.533258 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef73d8a7-a09c-418c-ba7f-f773cf20596b None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:50.549806 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 63/129] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jul 15 20:36:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:36:50.550762 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef73d8a7-a09c-418c-ba7f-f773cf20596b None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:50.562469 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:50.575977 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd000fb-f50b-4576-bae1-1d7b0616d791 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:50.635723 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1760090b-0989-49aa-838a-5391acf706c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:50.637107 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1760090b-0989-49aa-838a-5391acf706c1 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:50.637567 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1760090b-0989-49aa-838a-5391acf706c1 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:50.638018 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1760090b-0989-49aa-838a-5391acf706c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:50.661910 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef73d8a7-a09c-418c-ba7f-f773cf20596b None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:50.697154 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92101240-060f-4b81-a985-a001e6869bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:50.702094 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92101240-060f-4b81-a985-a001e6869bfb None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:50.702094 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92101240-060f-4b81-a985-a001e6869bfb None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:50.702094 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92101240-060f-4b81-a985-a001e6869bfb None admin] PATH_INFO: `/v3/projects/48e9b39bc1aa4bc393c66659e84a6690` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:50.702094 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92101240-060f-4b81-a985-a001e6869bfb None admin] RBAC: Authorizing `identity:get_project(project_id=48e9b39bc1aa4bc393c66659e84a6690)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:50.702094 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92101240-060f-4b81-a985-a001e6869bfb None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:50.703597 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 64/130] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jul 15 20:36:50 2022] GET /identity/v3/projects/48e9b39bc1aa4bc393c66659e84a6690 => generated 312 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:36:50.704201 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92101240-060f-4b81-a985-a001e6869bfb None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:50.765136 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1760090b-0989-49aa-838a-5391acf706c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:50.776661 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1760090b-0989-49aa-838a-5391acf706c1 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:50.810352 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92101240-060f-4b81-a985-a001e6869bfb None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:50.826540 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:50.854477 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2208728-2405-4439-ac28-1512dfc0ca3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:50.855517 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2208728-2405-4439-ac28-1512dfc0ca3f None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:50.855804 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2208728-2405-4439-ac28-1512dfc0ca3f None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:50.856410 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2208728-2405-4439-ac28-1512dfc0ca3f None admin] PATH_INFO: `/v3/users/bbd59331bbaf47468ccbb663718c3841` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:50.858343 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2208728-2405-4439-ac28-1512dfc0ca3f None admin] RBAC: Authorizing `identity:get_user(user_id=bbd59331bbaf47468ccbb663718c3841)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:50.860403 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2208728-2405-4439-ac28-1512dfc0ca3f None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:50.862054 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 65/131] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jul 15 20:36:50 2022] GET /identity/v3/users/bbd59331bbaf47468ccbb663718c3841 => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:36:50.871028 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2208728-2405-4439-ac28-1512dfc0ca3f None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:50.902947 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:50.907339 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 67/132] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jul 15 20:36:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 20:36:50.910124 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1760090b-0989-49aa-838a-5391acf706c1 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:51.030114 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2208728-2405-4439-ac28-1512dfc0ca3f None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:51.046540 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:51.079917 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a1a214-fff4-4e8d-8a3c-e41842ce56d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:51.080826 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a1a214-fff4-4e8d-8a3c-e41842ce56d2 None admin] REQUEST_METHOD: `PUT` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:51.081122 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a1a214-fff4-4e8d-8a3c-e41842ce56d2 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:51.081410 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a1a214-fff4-4e8d-8a3c-e41842ce56d2 None admin] PATH_INFO: `/v3/projects/48e9b39bc1aa4bc393c66659e84a6690/users/bbd59331bbaf47468ccbb663718c3841/roles/478906d6337444e68ea74da908d9a24d` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:51.083595 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a1a214-fff4-4e8d-8a3c-e41842ce56d2 None admin] RBAC: Authorizing `identity:create_grant(project_id=48e9b39bc1aa4bc393c66659e84a6690, user_id=bbd59331bbaf47468ccbb663718c3841, role_id=478906d6337444e68ea74da908d9a24d)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:51.085051 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a1a214-fff4-4e8d-8a3c-e41842ce56d2 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:51.108016 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 66/133] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Jul 15 20:36:50 2022] PUT /identity/v3/projects/48e9b39bc1aa4bc393c66659e84a6690/users/bbd59331bbaf47468ccbb663718c3841/roles/478906d6337444e68ea74da908d9a24d => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:36:51.109052 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a1a214-fff4-4e8d-8a3c-e41842ce56d2 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:51.122646 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1760090b-0989-49aa-838a-5391acf706c1 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:51.193237 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd0e3d4-14a0-4a6a-b59c-33c4a7f2cb26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:51.194946 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd0e3d4-14a0-4a6a-b59c-33c4a7f2cb26 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:51.197360 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd0e3d4-14a0-4a6a-b59c-33c4a7f2cb26 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:51.197923 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd0e3d4-14a0-4a6a-b59c-33c4a7f2cb26 None admin] PATH_INFO: `/v3/projects/ce682a869504492d931a06b90986fa49` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:51.200539 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd0e3d4-14a0-4a6a-b59c-33c4a7f2cb26 None admin] RBAC: Authorizing `identity:get_project(project_id=ce682a869504492d931a06b90986fa49)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:51.202434 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd0e3d4-14a0-4a6a-b59c-33c4a7f2cb26 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:51.204540 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 68/134] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jul 15 20:36:50 2022] GET /identity/v3/projects/ce682a869504492d931a06b90986fa49 => generated 298 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:36:51.210130 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd0e3d4-14a0-4a6a-b59c-33c4a7f2cb26 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:51.281075 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:51.302679 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a1a214-fff4-4e8d-8a3c-e41842ce56d2 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:51.349743 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e19db1-f751-4973-822f-7cc9dc1d39b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:51.353028 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e19db1-f751-4973-822f-7cc9dc1d39b8 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:51.354706 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e19db1-f751-4973-822f-7cc9dc1d39b8 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:51.355882 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e19db1-f751-4973-822f-7cc9dc1d39b8 None admin] PATH_INFO: `/v3/projects/ce682a869504492d931a06b90986fa49` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:51.360516 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e19db1-f751-4973-822f-7cc9dc1d39b8 None admin] RBAC: Authorizing `identity:get_project(project_id=ce682a869504492d931a06b90986fa49)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:51.363069 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e19db1-f751-4973-822f-7cc9dc1d39b8 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:51.365060 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 67/135] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jul 15 20:36:51 2022] GET /identity/v3/projects/ce682a869504492d931a06b90986fa49 => generated 298 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:36:51.366589 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ef5ec3-770a-4d2f-9bb5-a0ce8a4d63f2 None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:51.367091 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ef5ec3-770a-4d2f-9bb5-a0ce8a4d63f2 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:51.367614 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ef5ec3-770a-4d2f-9bb5-a0ce8a4d63f2 None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:51.369455 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 68/136] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:36:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:36:51.374638 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40187640-8036-437f-a4e0-daa925904dac None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:51.375255 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40187640-8036-437f-a4e0-daa925904dac None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:51.375752 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40187640-8036-437f-a4e0-daa925904dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:51.381402 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd0e3d4-14a0-4a6a-b59c-33c4a7f2cb26 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:51.396027 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-40187640-8036-437f-a4e0-daa925904dac None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:51.397557 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-40187640-8036-437f-a4e0-daa925904dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:51.418415 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075a01aa-4261-45dd-ae3d-3eb664199ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:51.419312 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a01aa-4261-45dd-ae3d-3eb664199ac3 None admin] REQUEST_METHOD: `PUT` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:51.419603 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a01aa-4261-45dd-ae3d-3eb664199ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:51.419887 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a01aa-4261-45dd-ae3d-3eb664199ac3 None admin] PATH_INFO: `/v3/projects/ce682a869504492d931a06b90986fa49/users/bbd59331bbaf47468ccbb663718c3841/roles/7deae0ce5d074f488024c63c8ce63928` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:51.422743 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075a01aa-4261-45dd-ae3d-3eb664199ac3 None admin] RBAC: Authorizing `identity:create_grant(project_id=ce682a869504492d931a06b90986fa49, user_id=bbd59331bbaf47468ccbb663718c3841, role_id=7deae0ce5d074f488024c63c8ce63928)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:51.424222 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075a01aa-4261-45dd-ae3d-3eb664199ac3 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:51.437741 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:51.442355 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 69/137] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Jul 15 20:36:51 2022] PUT /identity/v3/projects/ce682a869504492d931a06b90986fa49/users/bbd59331bbaf47468ccbb663718c3841/roles/7deae0ce5d074f488024c63c8ce63928 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:36:51.442982 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075a01aa-4261-45dd-ae3d-3eb664199ac3 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:51.551674 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 69/138] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:36:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:36:51.587090 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40187640-8036-437f-a4e0-daa925904dac None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:51.678412 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075a01aa-4261-45dd-ae3d-3eb664199ac3 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:51.703813 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:51.742478 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5ef2ed-43fa-468d-924e-cbf0f4b47038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:51.744011 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5ef2ed-43fa-468d-924e-cbf0f4b47038 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:51.744498 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5ef2ed-43fa-468d-924e-cbf0f4b47038 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:51.744968 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5ef2ed-43fa-468d-924e-cbf0f4b47038 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:51.745992 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5ef2ed-43fa-468d-924e-cbf0f4b47038 None admin] RBAC: Adding query filter params (role.id=e2a7ac9ae1fe4d4b988ae2dc2c8ab021, scope.project.id=ce682a869504492d931a06b90986fa49, user.id=978d6e4088c54f40980db9bee13bed32) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:36:51.750936 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5ef2ed-43fa-468d-924e-cbf0f4b47038 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:51.752665 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5ef2ed-43fa-468d-924e-cbf0f4b47038 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:51.761573 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 70/139] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jul 15 20:36:51 2022] GET /identity/v3/role_assignments?user.id=978d6e4088c54f40980db9bee13bed32&scope.project.id=ce682a869504492d931a06b90986fa49&role.id=e2a7ac9ae1fe4d4b988ae2dc2c8ab021 => generated 259 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:36:51.833435 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40187640-8036-437f-a4e0-daa925904dac None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:51.886992 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616c5623-bfeb-4787-b18c-d4d4b80384c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:51.887836 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c5623-bfeb-4787-b18c-d4d4b80384c3 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:51.888134 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c5623-bfeb-4787-b18c-d4d4b80384c3 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:51.888417 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c5623-bfeb-4787-b18c-d4d4b80384c3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:51.903810 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616c5623-bfeb-4787-b18c-d4d4b80384c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:36:51.912267 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-616c5623-bfeb-4787-b18c-d4d4b80384c3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 20:36:51.912267 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:36:51.912267 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:36:51.912267 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:36:51.912267 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:36:51.912267 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:36:51.912267 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:36:51.912267 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:36:51.912267 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:36:51.912267 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:36:51.912267 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:36:51.912267 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:36:51.912267 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:36:51.912267 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:36:51.912267 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:36:51.912267 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:36:51.913086 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:36:51.913086 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:36:51.913086 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:36:51.913086 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:36:51.913086 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:36:51.913086 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:36:51.913086 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:36:51.913086 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:36:51.913086 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:36:51.913086 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:36:51.913086 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:36:51.913086 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:36:51.913086 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:36:51.913086 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:36:51.913086 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:36:51.913086 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:36:51.914274 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:36:51.914274 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:36:51.914274 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:36:51.914274 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:36:51.914274 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:36:51.914274 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:36:51.914274 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:36:51.914274 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:36:51.914274 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:36:51.914274 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:36:51.914274 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 20:36:51.914274 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:36:51.914274 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 70/140] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jul 15 20:36:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:36:51.919403 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5ef2ed-43fa-468d-924e-cbf0f4b47038 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:52.029377 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1aeab5-bcdb-4a35-8493-749eedab96c9 None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:52.029687 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1aeab5-bcdb-4a35-8493-749eedab96c9 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:52.029951 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1aeab5-bcdb-4a35-8493-749eedab96c9 None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:52.031803 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 71/141] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:36:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:36:52.043580 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8621d1ab-c9e1-4113-a00a-be3490a53c4b None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:52.043868 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8621d1ab-c9e1-4113-a00a-be3490a53c4b None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:52.044149 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8621d1ab-c9e1-4113-a00a-be3490a53c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:52.086022 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-8621d1ab-c9e1-4113-a00a-be3490a53c4b None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:52.087199 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-8621d1ab-c9e1-4113-a00a-be3490a53c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:52.095034 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5ef2ed-43fa-468d-924e-cbf0f4b47038 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:52.134439 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:52.156752 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174fa2a0-0c81-4da5-9489-d4b5c298e05a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:52.157434 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174fa2a0-0c81-4da5-9489-d4b5c298e05a None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:52.157728 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174fa2a0-0c81-4da5-9489-d4b5c298e05a None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:52.158029 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174fa2a0-0c81-4da5-9489-d4b5c298e05a None admin] PATH_INFO: `/v3/roles` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:52.158809 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174fa2a0-0c81-4da5-9489-d4b5c298e05a None admin] RBAC: Adding query filter params (name=member) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:36:52.159132 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174fa2a0-0c81-4da5-9489-d4b5c298e05a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:52.160517 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174fa2a0-0c81-4da5-9489-d4b5c298e05a None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:52.178659 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 71/142] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Jul 15 20:36:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:36:52.185523 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174fa2a0-0c81-4da5-9489-d4b5c298e05a None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:52.218635 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 72/143] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:36:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:36:52.248819 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:52.283514 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8621d1ab-c9e1-4113-a00a-be3490a53c4b None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:52.380915 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174fa2a0-0c81-4da5-9489-d4b5c298e05a None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:52.470868 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d85b77c-796b-4203-b5c3-ace1472dbc76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:52.474372 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d85b77c-796b-4203-b5c3-ace1472dbc76 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:52.474372 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d85b77c-796b-4203-b5c3-ace1472dbc76 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:52.474372 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d85b77c-796b-4203-b5c3-ace1472dbc76 None admin] PATH_INFO: `/v3/users/bbd59331bbaf47468ccbb663718c3841` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:52.476737 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8621d1ab-c9e1-4113-a00a-be3490a53c4b None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:52.479463 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d85b77c-796b-4203-b5c3-ace1472dbc76 None admin] RBAC: Authorizing `identity:get_user(user_id=bbd59331bbaf47468ccbb663718c3841)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:52.480364 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d85b77c-796b-4203-b5c3-ace1472dbc76 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:52.482091 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 72/144] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jul 15 20:36:52 2022] GET /identity/v3/users/bbd59331bbaf47468ccbb663718c3841 => generated 275 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:36:52.503399 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d85b77c-796b-4203-b5c3-ace1472dbc76 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:52.558631 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a377a38-e3d5-4b35-832b-e1316bca273b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:52.559445 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a377a38-e3d5-4b35-832b-e1316bca273b None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:52.559735 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a377a38-e3d5-4b35-832b-e1316bca273b None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:52.560258 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a377a38-e3d5-4b35-832b-e1316bca273b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:52.582632 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a377a38-e3d5-4b35-832b-e1316bca273b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:36:52.598539 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-7a377a38-e3d5-4b35-832b-e1316bca273b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:36:52.598539 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:36:52.598539 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:36:52.598539 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:36:52.598539 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:36:52.598539 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:36:52.598539 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:36:52.598539 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:36:52.598539 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:36:52.598539 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:36:52.598539 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:36:52.598539 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:36:52.598539 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:36:52.598539 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:36:52.598539 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:36:52.598539 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:36:52.599399 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:36:52.599399 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:36:52.599399 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:36:52.599399 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:36:52.599399 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:36:52.599399 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:36:52.599399 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:36:52.599399 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:36:52.599399 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:36:52.599399 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:36:52.599399 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:36:52.599399 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:36:52.599399 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:36:52.599399 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:36:52.599399 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:36:52.599399 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:36:52.600392 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:36:52.600392 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:36:52.600392 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:36:52.600392 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:36:52.600392 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:36:52.600392 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:36:52.600392 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:36:52.600392 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:36:52.600392 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:36:52.600392 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:36:52.600392 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:36:52.600392 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:36:52.600392 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 73/145] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Jul 15 20:36:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 20:36:52.607539 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a377a38-e3d5-4b35-832b-e1316bca273b None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:52.642604 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:52.705690 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d85b77c-796b-4203-b5c3-ace1472dbc76 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:52.716781 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:52.773374 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6271ec3a-420e-48a8-aa9f-def34df72a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:52.774030 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6271ec3a-420e-48a8-aa9f-def34df72a7c None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:52.774340 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6271ec3a-420e-48a8-aa9f-def34df72a7c None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:52.774621 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6271ec3a-420e-48a8-aa9f-def34df72a7c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:52.797470 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a377a38-e3d5-4b35-832b-e1316bca273b None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:52.869216 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6271ec3a-420e-48a8-aa9f-def34df72a7c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:52.871189 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6271ec3a-420e-48a8-aa9f-def34df72a7c None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:52.906041 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2132e079-24ec-4068-861d-32cce4eb5e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:52.906724 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132e079-24ec-4068-861d-32cce4eb5e01 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:52.907015 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132e079-24ec-4068-861d-32cce4eb5e01 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:52.907302 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132e079-24ec-4068-861d-32cce4eb5e01 None admin] PATH_INFO: `/v3/roles` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:52.908052 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2132e079-24ec-4068-861d-32cce4eb5e01 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:36:52.908362 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2132e079-24ec-4068-861d-32cce4eb5e01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:52.909754 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2132e079-24ec-4068-861d-32cce4eb5e01 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:52.941194 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 74/146] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jul 15 20:36:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:36:52.941194 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3e4bc4-c2ac-4fdc-9281-30aad9b284fb None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:52.941194 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3e4bc4-c2ac-4fdc-9281-30aad9b284fb None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:52.941194 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3e4bc4-c2ac-4fdc-9281-30aad9b284fb None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:52.941520 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 75/147] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:36:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:36:52.946187 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3e4bc4-c2ac-4fdc-9281-30aad9b284fb None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:53.026591 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 73/148] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jul 15 20:36:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 15 20:36:53.028184 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee488f-6cff-457b-9f01-af183acd7961 None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:53.030107 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee488f-6cff-457b-9f01-af183acd7961 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:53.030605 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee488f-6cff-457b-9f01-af183acd7961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:53.053390 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:53.065963 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-31ee488f-6cff-457b-9f01-af183acd7961 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:53.070134 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-31ee488f-6cff-457b-9f01-af183acd7961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:53.098546 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:53.134026 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3e4bc4-c2ac-4fdc-9281-30aad9b284fb None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:53.195380 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 74/149] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:36:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:36:53.196243 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ee488f-6cff-457b-9f01-af183acd7961 None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:53.197283 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f260f97-a14d-4cf3-9dca-9da0fef2f26c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:53.198189 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f260f97-a14d-4cf3-9dca-9da0fef2f26c None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:53.198478 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f260f97-a14d-4cf3-9dca-9da0fef2f26c None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:53.198762 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f260f97-a14d-4cf3-9dca-9da0fef2f26c None admin] PATH_INFO: `/v3/users/904f3e39010c4ee1ad10cdd271b0b153` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:53.201741 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f260f97-a14d-4cf3-9dca-9da0fef2f26c None admin] RBAC: Authorizing `identity:get_user(user_id=904f3e39010c4ee1ad10cdd271b0b153)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:53.203255 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f260f97-a14d-4cf3-9dca-9da0fef2f26c None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:53.204875 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 76/150] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jul 15 20:36:52 2022] GET /identity/v3/users/904f3e39010c4ee1ad10cdd271b0b153 => generated 247 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:36:53.215005 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f260f97-a14d-4cf3-9dca-9da0fef2f26c None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:53.407818 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ee488f-6cff-457b-9f01-af183acd7961 None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:53.419053 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f260f97-a14d-4cf3-9dca-9da0fef2f26c None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:53.482978 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e7a6ec-f266-49a6-b9fb-edfcc4abca31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:53.485562 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7a6ec-f266-49a6-b9fb-edfcc4abca31 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:53.487397 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d951af80-a149-4133-a528-37edc2746abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:53.487919 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7a6ec-f266-49a6-b9fb-edfcc4abca31 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:53.488777 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951af80-a149-4133-a528-37edc2746abc None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:53.489246 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7a6ec-f266-49a6-b9fb-edfcc4abca31 None admin] PATH_INFO: `/v3/projects/ce682a869504492d931a06b90986fa49` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:53.490408 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951af80-a149-4133-a528-37edc2746abc None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:53.491234 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e7a6ec-f266-49a6-b9fb-edfcc4abca31 None admin] RBAC: Authorizing `identity:get_project(project_id=ce682a869504492d931a06b90986fa49)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:53.491719 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951af80-a149-4133-a528-37edc2746abc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:53.493936 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e7a6ec-f266-49a6-b9fb-edfcc4abca31 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:53.497917 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 75/151] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jul 15 20:36:53 2022] GET /identity/v3/projects/ce682a869504492d931a06b90986fa49 => generated 298 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:36:53.499857 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e7a6ec-f266-49a6-b9fb-edfcc4abca31 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:53.510125 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:53.527286 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:53.623592 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d951af80-a149-4133-a528-37edc2746abc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:53.625120 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d951af80-a149-4133-a528-37edc2746abc None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:53.693876 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e7a6ec-f266-49a6-b9fb-edfcc4abca31 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:53.757282 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d8fe53-bb49-448c-8842-440c3119d6a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:53.758014 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d8fe53-bb49-448c-8842-440c3119d6a2 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:53.758965 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d8fe53-bb49-448c-8842-440c3119d6a2 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:53.759245 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d8fe53-bb49-448c-8842-440c3119d6a2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:53.761609 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d8fe53-bb49-448c-8842-440c3119d6a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:53.763068 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d8fe53-bb49-448c-8842-440c3119d6a2 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:53.770197 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 76/152] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jul 15 20:36:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:36:53.771039 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d8fe53-bb49-448c-8842-440c3119d6a2 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:53.807163 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 77/153] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jul 15 20:36:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 592 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 20:36:53.808900 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d951af80-a149-4133-a528-37edc2746abc None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:53.905791 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:53.909670 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:53.967077 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d8fe53-bb49-448c-8842-440c3119d6a2 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:54.002103 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d951af80-a149-4133-a528-37edc2746abc None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:54.026598 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051f09aa-1b9a-482b-b954-c23fd7b44bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:54.027183 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f09aa-1b9a-482b-b954-c23fd7b44bd6 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:54.027476 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f09aa-1b9a-482b-b954-c23fd7b44bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:54.027759 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f09aa-1b9a-482b-b954-c23fd7b44bd6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:54.028606 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051f09aa-1b9a-482b-b954-c23fd7b44bd6 None admin] RBAC: Adding query filter params (role.id=478906d6337444e68ea74da908d9a24d, scope.project.id=ce682a869504492d931a06b90986fa49, user.id=bbd59331bbaf47468ccbb663718c3841) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:36:54.028926 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051f09aa-1b9a-482b-b954-c23fd7b44bd6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:54.030530 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051f09aa-1b9a-482b-b954-c23fd7b44bd6 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:54.037769 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 77/154] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jul 15 20:36:53 2022] GET /identity/v3/role_assignments?user.id=bbd59331bbaf47468ccbb663718c3841&scope.project.id=ce682a869504492d931a06b90986fa49&role.id=478906d6337444e68ea74da908d9a24d => generated 608 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:36:54.038612 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051f09aa-1b9a-482b-b954-c23fd7b44bd6 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:54.068861 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8153d21c-3c8d-4559-8dd3-28682c443fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:54.069823 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8153d21c-3c8d-4559-8dd3-28682c443fca None admin] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:54.070133 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8153d21c-3c8d-4559-8dd3-28682c443fca None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:54.070417 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8153d21c-3c8d-4559-8dd3-28682c443fca None admin] PATH_INFO: `/v3/users` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:54.071145 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8153d21c-3c8d-4559-8dd3-28682c443fca None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:54.072672 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8153d21c-3c8d-4559-8dd3-28682c443fca None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:54.142479 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 78/155] 10.222.0.16 () {60 vars in 1132 bytes} [Fri Jul 15 20:36:53 2022] POST /identity/v3/users => generated 283 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:36:54.143846 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7a7b66-c701-42d2-a818-3faac8b5630a None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:54.144145 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7a7b66-c701-42d2-a818-3faac8b5630a None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:54.144430 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7a7b66-c701-42d2-a818-3faac8b5630a None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:54.152587 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 79/156] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:36:54 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:36:54.154101 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4167fbd-f6d2-498f-96d8-0c5fa8dd2614 None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:54.154401 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4167fbd-f6d2-498f-96d8-0c5fa8dd2614 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:54.154689 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4167fbd-f6d2-498f-96d8-0c5fa8dd2614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:54.193504 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-f4167fbd-f6d2-498f-96d8-0c5fa8dd2614 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:54.195042 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-f4167fbd-f6d2-498f-96d8-0c5fa8dd2614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:54.260782 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051f09aa-1b9a-482b-b954-c23fd7b44bd6 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:54.332827 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6942efeb-100e-4c7d-b8a0-a8f35451a908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:54.333608 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6942efeb-100e-4c7d-b8a0-a8f35451a908 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:54.333890 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6942efeb-100e-4c7d-b8a0-a8f35451a908 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:54.334189 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6942efeb-100e-4c7d-b8a0-a8f35451a908 None admin] PATH_INFO: `/v3/projects/ce682a869504492d931a06b90986fa49` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:54.336113 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6942efeb-100e-4c7d-b8a0-a8f35451a908 None admin] RBAC: Authorizing `identity:get_project(project_id=ce682a869504492d931a06b90986fa49)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:54.337588 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6942efeb-100e-4c7d-b8a0-a8f35451a908 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:54.340259 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 78/157] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jul 15 20:36:54 2022] GET /identity/v3/projects/ce682a869504492d931a06b90986fa49 => generated 298 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:36:54.344128 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 80/158] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:36:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 20:36:54.346525 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6942efeb-100e-4c7d-b8a0-a8f35451a908 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:54.366501 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:54.395512 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4167fbd-f6d2-498f-96d8-0c5fa8dd2614 None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:54.443188 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:54.498810 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6942efeb-100e-4c7d-b8a0-a8f35451a908 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:54.544388 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32443214-3ae0-4000-9c40-ef274c9bf078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:54.545053 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32443214-3ae0-4000-9c40-ef274c9bf078 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:54.545338 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32443214-3ae0-4000-9c40-ef274c9bf078 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:54.545614 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32443214-3ae0-4000-9c40-ef274c9bf078 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:54.547243 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32443214-3ae0-4000-9c40-ef274c9bf078 None admin] RBAC: Adding query filter params (role.id=cbcae224848142ce888ca5b84abfd18e, scope.project.id=ce682a869504492d931a06b90986fa49, user.id=904f3e39010c4ee1ad10cdd271b0b153) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:36:54.547561 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32443214-3ae0-4000-9c40-ef274c9bf078 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:54.549087 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32443214-3ae0-4000-9c40-ef274c9bf078 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:54.556385 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 79/159] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jul 15 20:36:54 2022] GET /identity/v3/role_assignments?user.id=904f3e39010c4ee1ad10cdd271b0b153&scope.project.id=ce682a869504492d931a06b90986fa49&role.id=cbcae224848142ce888ca5b84abfd18e => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:36:54.557510 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4167fbd-f6d2-498f-96d8-0c5fa8dd2614 None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:54.600425 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b26846-1f0f-4bfd-98d8-68810c3d5ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:54.601571 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b26846-1f0f-4bfd-98d8-68810c3d5ba9 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:54.602055 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b26846-1f0f-4bfd-98d8-68810c3d5ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:54.602586 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b26846-1f0f-4bfd-98d8-68810c3d5ba9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:54.615733 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b26846-1f0f-4bfd-98d8-68810c3d5ba9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:36:54.624311 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-05b26846-1f0f-4bfd-98d8-68810c3d5ba9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 20:36:54.624311 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:36:54.624311 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:36:54.624311 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:36:54.624311 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:36:54.624311 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:36:54.624311 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:36:54.624311 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:36:54.624311 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:36:54.624311 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:36:54.624311 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:36:54.624311 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:36:54.624311 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:36:54.624311 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:36:54.624311 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:36:54.624311 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:36:54.626376 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:36:54.626376 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:36:54.626376 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:36:54.626376 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:36:54.626376 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:36:54.626376 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:36:54.626376 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:36:54.626376 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:36:54.626376 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:36:54.626376 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:36:54.626376 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:36:54.626376 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:36:54.626376 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:36:54.626376 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:36:54.626376 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:36:54.626376 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:36:54.627131 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:36:54.627131 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:36:54.627131 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:36:54.627131 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:36:54.627131 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:36:54.627131 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:36:54.627131 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:36:54.627131 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:36:54.627131 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:36:54.627131 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:36:54.627131 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 20:36:54.627131 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:36:54.630096 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 81/160] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jul 15 20:36:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:36:54.635710 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32443214-3ae0-4000-9c40-ef274c9bf078 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:54.687537 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf11ab98-b8f4-4236-bccd-75a9d8c8117b None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:54.688345 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf11ab98-b8f4-4236-bccd-75a9d8c8117b None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:54.688605 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf11ab98-b8f4-4236-bccd-75a9d8c8117b None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:54.690304 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 82/161] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:36:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 20:36:54.691512 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c2de6-1f16-41df-9c73-7549afa4460e None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:54.691801 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c2de6-1f16-41df-9c73-7549afa4460e None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:54.692081 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c2de6-1f16-41df-9c73-7549afa4460e None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:54.693395 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 83/162] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:36:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:36:54.699555 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c68946-3fde-43f5-84bf-deac56799df4 None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:54.699850 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c68946-3fde-43f5-84bf-deac56799df4 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:54.700137 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c68946-3fde-43f5-84bf-deac56799df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:54.722923 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-11c68946-3fde-43f5-84bf-deac56799df4 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:54.724144 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-11c68946-3fde-43f5-84bf-deac56799df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:54.732031 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:54.774991 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32443214-3ae0-4000-9c40-ef274c9bf078 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:54.821245 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 84/163] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:36:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:36:54.823414 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8886eff4-d5ac-4d88-982d-8ce57ca4ff81 None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:54.824032 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8886eff4-d5ac-4d88-982d-8ce57ca4ff81 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:54.824397 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1115dc-dfa2-46b0-ab51-069f81e0ccaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:54.824686 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8886eff4-d5ac-4d88-982d-8ce57ca4ff81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:54.825206 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1115dc-dfa2-46b0-ab51-069f81e0ccaf None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:54.825559 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1115dc-dfa2-46b0-ab51-069f81e0ccaf None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:54.825902 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1115dc-dfa2-46b0-ab51-069f81e0ccaf None admin] PATH_INFO: `/v3/roles` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:54.826769 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1115dc-dfa2-46b0-ab51-069f81e0ccaf None admin] RBAC: Adding query filter params (name=member) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:36:54.827145 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1115dc-dfa2-46b0-ab51-069f81e0ccaf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:54.829231 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1115dc-dfa2-46b0-ab51-069f81e0ccaf None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:54.841306 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 80/164] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Jul 15 20:36:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:36:54.844772 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-8886eff4-d5ac-4d88-982d-8ce57ca4ff81 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:54.846410 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-8886eff4-d5ac-4d88-982d-8ce57ca4ff81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:54.847062 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1115dc-dfa2-46b0-ab51-069f81e0ccaf None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:54.870319 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:54.930611 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 85/165] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:36:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:36:54.931476 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8886eff4-d5ac-4d88-982d-8ce57ca4ff81 None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:54.969691 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1115dc-dfa2-46b0-ab51-069f81e0ccaf None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:55.011948 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:55.021043 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe31895-44de-489b-b323-752eb23bf888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:55.021930 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe31895-44de-489b-b323-752eb23bf888 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:55.022703 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe31895-44de-489b-b323-752eb23bf888 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:55.022990 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe31895-44de-489b-b323-752eb23bf888 None admin] PATH_INFO: `/v3/users/bbd59331bbaf47468ccbb663718c3841` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:55.024586 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe31895-44de-489b-b323-752eb23bf888 None admin] RBAC: Authorizing `identity:get_user(user_id=bbd59331bbaf47468ccbb663718c3841)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:55.026691 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe31895-44de-489b-b323-752eb23bf888 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:55.028737 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 81/166] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jul 15 20:36:54 2022] GET /identity/v3/users/bbd59331bbaf47468ccbb663718c3841 => generated 275 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:36:55.029758 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe31895-44de-489b-b323-752eb23bf888 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:55.052478 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8886eff4-d5ac-4d88-982d-8ce57ca4ff81 None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:55.100995 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aac671e-f949-4b2e-a05f-d51ad4fd73d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:55.101862 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac671e-f949-4b2e-a05f-d51ad4fd73d5 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:55.102273 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac671e-f949-4b2e-a05f-d51ad4fd73d5 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:55.102561 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac671e-f949-4b2e-a05f-d51ad4fd73d5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:55.114600 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aac671e-f949-4b2e-a05f-d51ad4fd73d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:36:55.122946 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-5aac671e-f949-4b2e-a05f-d51ad4fd73d5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 20:36:55.122946 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:36:55.122946 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:36:55.122946 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:36:55.122946 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:36:55.122946 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:36:55.122946 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:36:55.122946 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:36:55.122946 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:36:55.122946 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:36:55.122946 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:36:55.122946 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:36:55.122946 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:36:55.122946 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:36:55.122946 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:36:55.122946 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:36:55.123847 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:36:55.123847 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:36:55.123847 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:36:55.123847 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:36:55.123847 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:36:55.123847 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:36:55.123847 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:36:55.123847 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:36:55.123847 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:36:55.123847 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:36:55.123847 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:36:55.123847 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:36:55.123847 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:36:55.123847 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:36:55.123847 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:36:55.123847 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:36:55.124875 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:36:55.124875 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:36:55.124875 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:36:55.124875 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:36:55.124875 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:36:55.124875 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:36:55.124875 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:36:55.124875 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:36:55.124875 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:36:55.124875 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:36:55.124875 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 20:36:55.124875 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:36:55.124875 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 86/167] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Jul 15 20:36:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:36:55.126058 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aac671e-f949-4b2e-a05f-d51ad4fd73d5 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:55.148394 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:55.162778 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe31895-44de-489b-b323-752eb23bf888 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:55.234908 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362c8c40-5d92-44e0-a451-7f2d806d328f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:55.235773 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362c8c40-5d92-44e0-a451-7f2d806d328f None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:55.236063 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362c8c40-5d92-44e0-a451-7f2d806d328f None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:55.236346 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362c8c40-5d92-44e0-a451-7f2d806d328f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:55.258405 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aac671e-f949-4b2e-a05f-d51ad4fd73d5 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:55.273602 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362c8c40-5d92-44e0-a451-7f2d806d328f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:36:55.286151 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-362c8c40-5d92-44e0-a451-7f2d806d328f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 20:36:55.286151 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:36:55.286151 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:36:55.286151 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:36:55.286151 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:36:55.286151 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:36:55.286151 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:36:55.286151 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:36:55.286151 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:36:55.286151 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:36:55.286151 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:36:55.286151 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:36:55.286151 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:36:55.286151 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:36:55.286151 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:36:55.286151 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:36:55.287023 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:36:55.287023 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:36:55.287023 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:36:55.287023 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:36:55.287023 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:36:55.287023 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:36:55.287023 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:36:55.287023 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:36:55.287023 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:36:55.287023 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:36:55.287023 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:36:55.287023 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:36:55.287023 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:36:55.287023 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:36:55.287023 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:36:55.287023 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:36:55.288215 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:36:55.288215 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:36:55.288215 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:36:55.288215 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:36:55.288215 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:36:55.288215 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:36:55.288215 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:36:55.288215 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:36:55.288215 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:36:55.288215 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:36:55.288215 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 20:36:55.288215 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:36:55.288215 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 82/168] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jul 15 20:36:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:36:55.289055 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362c8c40-5d92-44e0-a451-7f2d806d328f None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:55.309399 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aed41b5-ced2-4463-8c6d-717c2ec9fa9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:55.310065 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aed41b5-ced2-4463-8c6d-717c2ec9fa9e None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:55.310455 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aed41b5-ced2-4463-8c6d-717c2ec9fa9e None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:55.310848 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aed41b5-ced2-4463-8c6d-717c2ec9fa9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:55.385542 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:55.438300 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362c8c40-5d92-44e0-a451-7f2d806d328f None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:55.487004 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aed41b5-ced2-4463-8c6d-717c2ec9fa9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:55.488504 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aed41b5-ced2-4463-8c6d-717c2ec9fa9e None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:55.508239 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8181ea7d-d8f4-4f67-88e6-20b43c4f0ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:55.508916 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8181ea7d-d8f4-4f67-88e6-20b43c4f0ed3 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:55.509203 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8181ea7d-d8f4-4f67-88e6-20b43c4f0ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:55.509484 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8181ea7d-d8f4-4f67-88e6-20b43c4f0ed3 None admin] PATH_INFO: `/v3/roles` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:55.510452 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8181ea7d-d8f4-4f67-88e6-20b43c4f0ed3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:36:55.510554 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8181ea7d-d8f4-4f67-88e6-20b43c4f0ed3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:55.512154 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8181ea7d-d8f4-4f67-88e6-20b43c4f0ed3 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:55.513552 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:55.527543 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 83/169] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jul 15 20:36:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:36:55.528667 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8181ea7d-d8f4-4f67-88e6-20b43c4f0ed3 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:55.642497 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8181ea7d-d8f4-4f67-88e6-20b43c4f0ed3 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:55.670432 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:55.680441 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1565aba1-2e64-4753-b149-ef281ab045f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:55.681410 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1565aba1-2e64-4753-b149-ef281ab045f5 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:55.681904 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1565aba1-2e64-4753-b149-ef281ab045f5 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:55.682402 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1565aba1-2e64-4753-b149-ef281ab045f5 None admin] PATH_INFO: `/v3/roles` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:55.683492 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1565aba1-2e64-4753-b149-ef281ab045f5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:36:55.684160 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1565aba1-2e64-4753-b149-ef281ab045f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:55.685812 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1565aba1-2e64-4753-b149-ef281ab045f5 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:55.696979 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 84/170] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Jul 15 20:36:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:36:55.698181 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1565aba1-2e64-4753-b149-ef281ab045f5 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:55.813796 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1565aba1-2e64-4753-b149-ef281ab045f5 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:55.823870 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 87/171] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jul 15 20:36:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 699 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 20:36:55.824599 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aed41b5-ced2-4463-8c6d-717c2ec9fa9e None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:55.857894 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb695c4b-58d8-4096-9027-89469c840894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:55.860571 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb695c4b-58d8-4096-9027-89469c840894 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:55.861142 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb695c4b-58d8-4096-9027-89469c840894 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:55.861967 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb695c4b-58d8-4096-9027-89469c840894 None admin] PATH_INFO: `/v3/users/bbd59331bbaf47468ccbb663718c3841` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:55.866125 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb695c4b-58d8-4096-9027-89469c840894 None admin] RBAC: Authorizing `identity:get_user(user_id=bbd59331bbaf47468ccbb663718c3841)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:55.868802 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb695c4b-58d8-4096-9027-89469c840894 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:55.871701 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 85/172] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jul 15 20:36:55 2022] GET /identity/v3/users/bbd59331bbaf47468ccbb663718c3841 => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:36:55.872836 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb695c4b-58d8-4096-9027-89469c840894 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:55.962436 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:56.008719 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb695c4b-58d8-4096-9027-89469c840894 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:56.058845 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4259b7f4-e90f-4e48-a211-77a67d92a373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:56.061178 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4259b7f4-e90f-4e48-a211-77a67d92a373 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:56.061957 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4259b7f4-e90f-4e48-a211-77a67d92a373 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:56.062494 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4259b7f4-e90f-4e48-a211-77a67d92a373 None admin] PATH_INFO: `/v3/projects/48e9b39bc1aa4bc393c66659e84a6690` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:56.064585 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4259b7f4-e90f-4e48-a211-77a67d92a373 None admin] RBAC: Authorizing `identity:get_project(project_id=48e9b39bc1aa4bc393c66659e84a6690)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:56.066847 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4259b7f4-e90f-4e48-a211-77a67d92a373 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:56.069997 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 86/173] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jul 15 20:36:55 2022] GET /identity/v3/projects/48e9b39bc1aa4bc393c66659e84a6690 => generated 312 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:36:56.070266 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aed41b5-ced2-4463-8c6d-717c2ec9fa9e None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:56.071197 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4259b7f4-e90f-4e48-a211-77a67d92a373 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:56.104179 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:56.185207 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4259b7f4-e90f-4e48-a211-77a67d92a373 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:56.185971 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb38af-4d04-4264-a8a1-76c0e2974892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:56.186881 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb38af-4d04-4264-a8a1-76c0e2974892 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:56.187171 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb38af-4d04-4264-a8a1-76c0e2974892 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:56.187478 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb38af-4d04-4264-a8a1-76c0e2974892 None admin] PATH_INFO: `/v3/users/978d6e4088c54f40980db9bee13bed32` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:56.189916 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cb38af-4d04-4264-a8a1-76c0e2974892 None admin] RBAC: Authorizing `identity:get_user(user_id=978d6e4088c54f40980db9bee13bed32)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:56.190711 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cb38af-4d04-4264-a8a1-76c0e2974892 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:56.192351 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 88/174] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jul 15 20:36:55 2022] GET /identity/v3/users/978d6e4088c54f40980db9bee13bed32 => generated 289 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:36:56.193118 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb38af-4d04-4264-a8a1-76c0e2974892 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:56.222539 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:56.228346 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d518e539-78e4-412f-9630-3e0595b61426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:56.229310 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d518e539-78e4-412f-9630-3e0595b61426 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:56.229841 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d518e539-78e4-412f-9630-3e0595b61426 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:56.230371 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d518e539-78e4-412f-9630-3e0595b61426 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:56.314687 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d518e539-78e4-412f-9630-3e0595b61426 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:56.317417 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d518e539-78e4-412f-9630-3e0595b61426 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:56.387748 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb38af-4d04-4264-a8a1-76c0e2974892 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:56.429634 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb56f7a0-9df0-4e1e-859b-39d2189b64cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:56.430687 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb56f7a0-9df0-4e1e-859b-39d2189b64cd None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:56.431238 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb56f7a0-9df0-4e1e-859b-39d2189b64cd None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:56.431713 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb56f7a0-9df0-4e1e-859b-39d2189b64cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:56.432787 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb56f7a0-9df0-4e1e-859b-39d2189b64cd None admin] RBAC: Adding query filter params (role.id=478906d6337444e68ea74da908d9a24d, scope.project.id=48e9b39bc1aa4bc393c66659e84a6690, user.id=bbd59331bbaf47468ccbb663718c3841) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:36:56.433301 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb56f7a0-9df0-4e1e-859b-39d2189b64cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:56.434973 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb56f7a0-9df0-4e1e-859b-39d2189b64cd None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:56.442944 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 89/175] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jul 15 20:36:56 2022] GET /identity/v3/role_assignments?user.id=bbd59331bbaf47468ccbb663718c3841&scope.project.id=48e9b39bc1aa4bc393c66659e84a6690&role.id=478906d6337444e68ea74da908d9a24d => generated 608 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:36:56.444018 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb56f7a0-9df0-4e1e-859b-39d2189b64cd None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:56.509302 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:56.573668 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb56f7a0-9df0-4e1e-859b-39d2189b64cd None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:56.614015 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dd2c9f-7a45-4527-b866-66ad41edec95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:56.615445 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd2c9f-7a45-4527-b866-66ad41edec95 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:56.615998 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd2c9f-7a45-4527-b866-66ad41edec95 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:56.616471 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd2c9f-7a45-4527-b866-66ad41edec95 None admin] PATH_INFO: `/v3/projects/ce682a869504492d931a06b90986fa49` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:56.618239 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dd2c9f-7a45-4527-b866-66ad41edec95 None admin] RBAC: Authorizing `identity:get_project(project_id=ce682a869504492d931a06b90986fa49)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:56.620216 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dd2c9f-7a45-4527-b866-66ad41edec95 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:56.622237 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 90/176] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jul 15 20:36:56 2022] GET /identity/v3/projects/ce682a869504492d931a06b90986fa49 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:36:56.631263 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dd2c9f-7a45-4527-b866-66ad41edec95 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:56.637088 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 87/177] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jul 15 20:36:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 20:36:56.642697 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d518e539-78e4-412f-9630-3e0595b61426 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:56.698153 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:56.813162 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d518e539-78e4-412f-9630-3e0595b61426 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:56.857643 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2696c0-9fd6-4041-9089-67b08ad13f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:56.859907 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2696c0-9fd6-4041-9089-67b08ad13f11 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:56.861913 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dd2c9f-7a45-4527-b866-66ad41edec95 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:56.862773 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2696c0-9fd6-4041-9089-67b08ad13f11 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:56.863283 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2696c0-9fd6-4041-9089-67b08ad13f11 None admin] PATH_INFO: `/v3/projects/ce682a869504492d931a06b90986fa49` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:56.866198 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2696c0-9fd6-4041-9089-67b08ad13f11 None admin] RBAC: Authorizing `identity:get_project(project_id=ce682a869504492d931a06b90986fa49)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:56.867879 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2696c0-9fd6-4041-9089-67b08ad13f11 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:56.872757 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 88/178] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jul 15 20:36:56 2022] GET /identity/v3/projects/ce682a869504492d931a06b90986fa49 => generated 298 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:36:56.878595 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2696c0-9fd6-4041-9089-67b08ad13f11 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:56.902450 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:56.936097 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b990c573-8fa0-458b-885e-c0d721252d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:56.937340 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b990c573-8fa0-458b-885e-c0d721252d9b None admin] REQUEST_METHOD: `PUT` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:56.937896 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b990c573-8fa0-458b-885e-c0d721252d9b None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:56.938409 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b990c573-8fa0-458b-885e-c0d721252d9b None admin] PATH_INFO: `/v3/projects/ce682a869504492d931a06b90986fa49/users/978d6e4088c54f40980db9bee13bed32/roles/e2a7ac9ae1fe4d4b988ae2dc2c8ab021` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:56.943383 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b990c573-8fa0-458b-885e-c0d721252d9b None admin] RBAC: Authorizing `identity:create_grant(project_id=ce682a869504492d931a06b90986fa49, user_id=978d6e4088c54f40980db9bee13bed32, role_id=e2a7ac9ae1fe4d4b988ae2dc2c8ab021)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:56.945321 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b990c573-8fa0-458b-885e-c0d721252d9b None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:56.985624 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 91/179] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Jul 15 20:36:56 2022] PUT /identity/v3/projects/ce682a869504492d931a06b90986fa49/users/978d6e4088c54f40980db9bee13bed32/roles/e2a7ac9ae1fe4d4b988ae2dc2c8ab021 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:36:56.995703 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:57.015137 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2696c0-9fd6-4041-9089-67b08ad13f11 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:57.069837 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e8a0b6-83d3-4c07-a4a0-db8d917bd5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:57.070464 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e8a0b6-83d3-4c07-a4a0-db8d917bd5cc None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:57.070753 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e8a0b6-83d3-4c07-a4a0-db8d917bd5cc None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:57.071066 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e8a0b6-83d3-4c07-a4a0-db8d917bd5cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:57.071877 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e8a0b6-83d3-4c07-a4a0-db8d917bd5cc None admin] RBAC: Adding query filter params (role.id=7deae0ce5d074f488024c63c8ce63928, scope.project.id=ce682a869504492d931a06b90986fa49, user.id=bbd59331bbaf47468ccbb663718c3841) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:36:57.072224 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e8a0b6-83d3-4c07-a4a0-db8d917bd5cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:57.073667 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e8a0b6-83d3-4c07-a4a0-db8d917bd5cc None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:57.084069 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 89/180] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jul 15 20:36:56 2022] GET /identity/v3/role_assignments?user.id=bbd59331bbaf47468ccbb663718c3841&scope.project.id=ce682a869504492d931a06b90986fa49&role.id=7deae0ce5d074f488024c63c8ce63928 => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:36:57.336791 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab81b98d-223d-4cd0-972c-343070ce4367 None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:57.337501 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab81b98d-223d-4cd0-972c-343070ce4367 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:57.338009 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab81b98d-223d-4cd0-972c-343070ce4367 None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:57.339603 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 92/181] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:36:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:36:57.346353 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b1f62e-30d7-4b96-b4c8-6c997ff35960 None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:57.346950 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b1f62e-30d7-4b96-b4c8-6c997ff35960 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:57.347402 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b1f62e-30d7-4b96-b4c8-6c997ff35960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:57.371173 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-d5b1f62e-30d7-4b96-b4c8-6c997ff35960 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:57.372381 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-d5b1f62e-30d7-4b96-b4c8-6c997ff35960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:57.460681 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 90/182] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:36:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:36:57.486213 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab81b98d-223d-4cd0-972c-343070ce4367 None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:57.615685 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab81b98d-223d-4cd0-972c-343070ce4367 None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:57.659420 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde59bd1-7948-4b39-adf4-5dbce952b95e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:57.660212 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde59bd1-7948-4b39-adf4-5dbce952b95e None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:57.660493 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde59bd1-7948-4b39-adf4-5dbce952b95e None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:57.660768 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde59bd1-7948-4b39-adf4-5dbce952b95e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:57.671372 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde59bd1-7948-4b39-adf4-5dbce952b95e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:36:57.679151 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-cde59bd1-7948-4b39-adf4-5dbce952b95e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:36:57.679151 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:36:57.679151 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:36:57.679151 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:36:57.679151 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:36:57.679151 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:36:57.679151 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:36:57.679151 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:36:57.679151 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:36:57.679151 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:36:57.679151 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:36:57.679151 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:36:57.679151 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:36:57.679151 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:36:57.679151 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:36:57.679151 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:36:57.680036 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:36:57.680036 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:36:57.680036 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:36:57.680036 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:36:57.680036 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:36:57.680036 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:36:57.680036 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:36:57.680036 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:36:57.680036 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:36:57.680036 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:36:57.680036 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:36:57.680036 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:36:57.680036 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:36:57.680036 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:36:57.680036 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:36:57.680036 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:36:57.680801 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:36:57.680801 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:36:57.680801 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:36:57.680801 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:36:57.680801 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:36:57.680801 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:36:57.680801 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:36:57.680801 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:36:57.680801 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:36:57.680801 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:36:57.680801 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:36:57.680801 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:36:57.680801 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 93/183] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Jul 15 20:36:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:36:57.687188 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b1f62e-30d7-4b96-b4c8-6c997ff35960 None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:57.701869 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd468e-e6a5-4ab1-bf01-57e6faa25d70 None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:57.702212 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd468e-e6a5-4ab1-bf01-57e6faa25d70 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:57.702576 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd468e-e6a5-4ab1-bf01-57e6faa25d70 None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:57.704650 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 94/184] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:36:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 20:36:57.709961 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1554c008-d313-4d2c-a5a0-9bb6d1a574b8 None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:57.710279 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1554c008-d313-4d2c-a5a0-9bb6d1a574b8 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:57.710565 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1554c008-d313-4d2c-a5a0-9bb6d1a574b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:57.728686 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-1554c008-d313-4d2c-a5a0-9bb6d1a574b8 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:57.729865 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-1554c008-d313-4d2c-a5a0-9bb6d1a574b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:57.759862 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:57.789911 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:57.810120 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 95/185] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:36:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 20:36:57.810580 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ad3c8a-9891-41e7-9c2f-0b868c0946c5 None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:57.810865 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ad3c8a-9891-41e7-9c2f-0b868c0946c5 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:57.811141 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ad3c8a-9891-41e7-9c2f-0b868c0946c5 None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:57.812576 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 96/186] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:36:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:36:57.817588 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87bff8-b203-4d77-b797-39372f12ad00 None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:57.817884 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87bff8-b203-4d77-b797-39372f12ad00 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:57.818206 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87bff8-b203-4d77-b797-39372f12ad00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:57.820139 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b1f62e-30d7-4b96-b4c8-6c997ff35960 None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:57.835690 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-3c87bff8-b203-4d77-b797-39372f12ad00 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:57.836884 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-3c87bff8-b203-4d77-b797-39372f12ad00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:57.860694 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8625b2-a2a3-4e9d-8220-6813de5241a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:57.861370 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8625b2-a2a3-4e9d-8220-6813de5241a8 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:57.861665 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8625b2-a2a3-4e9d-8220-6813de5241a8 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:57.861951 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8625b2-a2a3-4e9d-8220-6813de5241a8 None admin] PATH_INFO: `/v3/roles` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:57.862734 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8625b2-a2a3-4e9d-8220-6813de5241a8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:36:57.863051 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8625b2-a2a3-4e9d-8220-6813de5241a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:57.864446 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8625b2-a2a3-4e9d-8220-6813de5241a8 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:57.872825 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 91/187] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jul 15 20:36:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:36:57.878148 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8625b2-a2a3-4e9d-8220-6813de5241a8 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:57.908242 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 97/188] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:36:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 20:36:57.914286 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c87bff8-b203-4d77-b797-39372f12ad00 None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:57.996515 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8625b2-a2a3-4e9d-8220-6813de5241a8 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:58.022875 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:58.031102 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c87bff8-b203-4d77-b797-39372f12ad00 None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:58.036206 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b46c6f7-4cdf-4f54-849e-abd99ce85ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:58.036998 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b46c6f7-4cdf-4f54-849e-abd99ce85ec2 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:58.037280 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b46c6f7-4cdf-4f54-849e-abd99ce85ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:58.037552 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b46c6f7-4cdf-4f54-849e-abd99ce85ec2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:58.038830 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b46c6f7-4cdf-4f54-849e-abd99ce85ec2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:58.040195 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b46c6f7-4cdf-4f54-849e-abd99ce85ec2 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:58.041985 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 92/189] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jul 15 20:36:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:36:58.047144 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b46c6f7-4cdf-4f54-849e-abd99ce85ec2 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:58.059071 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:58.069801 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb819bc-8648-4c4e-aaa1-a34dddba6450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:58.070707 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb819bc-8648-4c4e-aaa1-a34dddba6450 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:58.070997 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb819bc-8648-4c4e-aaa1-a34dddba6450 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:58.071267 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb819bc-8648-4c4e-aaa1-a34dddba6450 None admin] PATH_INFO: `/v3/users/240ef4c3a71c4a96adfacb933f4793ec` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:58.087212 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb819bc-8648-4c4e-aaa1-a34dddba6450 None admin] RBAC: Authorizing `identity:get_user(user_id=240ef4c3a71c4a96adfacb933f4793ec)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:58.088659 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb819bc-8648-4c4e-aaa1-a34dddba6450 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:58.094732 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 98/190] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jul 15 20:36:57 2022] GET /identity/v3/users/240ef4c3a71c4a96adfacb933f4793ec => generated 283 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:36:58.094732 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb819bc-8648-4c4e-aaa1-a34dddba6450 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:58.157011 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b46c6f7-4cdf-4f54-849e-abd99ce85ec2 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:58.191819 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c0045-9f0e-4903-9219-9ff28af8787e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:58.192622 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c0045-9f0e-4903-9219-9ff28af8787e None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:58.192911 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c0045-9f0e-4903-9219-9ff28af8787e None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:58.193193 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c0045-9f0e-4903-9219-9ff28af8787e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:58.197289 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb819bc-8648-4c4e-aaa1-a34dddba6450 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:58.204784 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3c0045-9f0e-4903-9219-9ff28af8787e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:36:58.213020 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-bd3c0045-9f0e-4903-9219-9ff28af8787e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 20:36:58.213020 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:36:58.213020 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:36:58.213020 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:36:58.213020 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:36:58.213020 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:36:58.213020 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:36:58.213020 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:36:58.213020 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:36:58.213020 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:36:58.213020 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:36:58.213020 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:36:58.213020 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:36:58.213020 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:36:58.213020 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:36:58.213020 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:36:58.213919 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:36:58.213919 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:36:58.213919 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:36:58.213919 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:36:58.213919 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:36:58.213919 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:36:58.213919 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:36:58.213919 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:36:58.213919 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:36:58.213919 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:36:58.213919 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:36:58.213919 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:36:58.213919 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:36:58.213919 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:36:58.213919 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:36:58.213919 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:36:58.214730 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:36:58.214730 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:36:58.214730 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:36:58.214730 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:36:58.214730 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:36:58.214730 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:36:58.214730 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:36:58.214730 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:36:58.214730 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:36:58.214730 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:36:58.214730 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 20:36:58.214730 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:36:58.214730 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 93/191] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Jul 15 20:36:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:36:58.216014 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c0045-9f0e-4903-9219-9ff28af8787e None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:58.239303 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e91d8be-a795-41cd-ab06-f027a69ce687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:58.239984 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e91d8be-a795-41cd-ab06-f027a69ce687 None admin] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:58.240278 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e91d8be-a795-41cd-ab06-f027a69ce687 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:58.240563 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e91d8be-a795-41cd-ab06-f027a69ce687 None admin] PATH_INFO: `/v3/users` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:58.241270 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e91d8be-a795-41cd-ab06-f027a69ce687 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:58.242769 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e91d8be-a795-41cd-ab06-f027a69ce687 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:58.274117 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 99/192] 10.222.0.16 () {60 vars in 1132 bytes} [Fri Jul 15 20:36:58 2022] POST /identity/v3/users => generated 297 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:36:58.274117 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e91d8be-a795-41cd-ab06-f027a69ce687 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:58.277553 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:58.316273 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:58.372472 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c0045-9f0e-4903-9219-9ff28af8787e None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:58.412404 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cf29a0-3b0b-49d3-bb52-73e4e8e75ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:58.413143 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf29a0-3b0b-49d3-bb52-73e4e8e75ee4 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:58.413441 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf29a0-3b0b-49d3-bb52-73e4e8e75ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:58.413729 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf29a0-3b0b-49d3-bb52-73e4e8e75ee4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:58.415437 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e91d8be-a795-41cd-ab06-f027a69ce687 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:58.467124 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c585d7c-fd95-498f-abbe-37487a04290f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:58.467823 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c585d7c-fd95-498f-abbe-37487a04290f None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:58.468202 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c585d7c-fd95-498f-abbe-37487a04290f None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:58.468493 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c585d7c-fd95-498f-abbe-37487a04290f None admin] PATH_INFO: `/v3/roles` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:58.469291 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c585d7c-fd95-498f-abbe-37487a04290f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:36:58.469605 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c585d7c-fd95-498f-abbe-37487a04290f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:58.471214 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c585d7c-fd95-498f-abbe-37487a04290f None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:58.481594 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 100/193] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jul 15 20:36:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:36:58.487133 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c585d7c-fd95-498f-abbe-37487a04290f None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:58.502994 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cf29a0-3b0b-49d3-bb52-73e4e8e75ee4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:58.504652 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cf29a0-3b0b-49d3-bb52-73e4e8e75ee4 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:58.579218 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:58.598346 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:58.622217 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c585d7c-fd95-498f-abbe-37487a04290f None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:58.639613 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 94/194] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jul 15 20:36:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 20:36:58.646445 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cf29a0-3b0b-49d3-bb52-73e4e8e75ee4 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:58.668692 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78428668-528f-42e5-a7ce-d0cf96bfcb66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:58.670051 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78428668-528f-42e5-a7ce-d0cf96bfcb66 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:58.670853 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78428668-528f-42e5-a7ce-d0cf96bfcb66 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:58.671296 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78428668-528f-42e5-a7ce-d0cf96bfcb66 None admin] PATH_INFO: `/v3/users/240ef4c3a71c4a96adfacb933f4793ec` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:58.673498 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78428668-528f-42e5-a7ce-d0cf96bfcb66 None admin] RBAC: Authorizing `identity:get_user(user_id=240ef4c3a71c4a96adfacb933f4793ec)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:58.675905 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78428668-528f-42e5-a7ce-d0cf96bfcb66 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:58.678514 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 101/195] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jul 15 20:36:58 2022] GET /identity/v3/users/240ef4c3a71c4a96adfacb933f4793ec => generated 283 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:36:58.684088 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78428668-528f-42e5-a7ce-d0cf96bfcb66 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:58.784895 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cf29a0-3b0b-49d3-bb52-73e4e8e75ee4 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:58.802172 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78428668-528f-42e5-a7ce-d0cf96bfcb66 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:58.830312 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c6eb32-a3c0-4177-9298-28e64316d30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:58.831539 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c6eb32-a3c0-4177-9298-28e64316d30f None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:58.832119 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c6eb32-a3c0-4177-9298-28e64316d30f None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:58.832956 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c6eb32-a3c0-4177-9298-28e64316d30f None admin] PATH_INFO: `/v3/projects/05cc472462c7477e9894e8c7c170ce4b` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:58.834636 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c6eb32-a3c0-4177-9298-28e64316d30f None admin] RBAC: Authorizing `identity:get_project(project_id=05cc472462c7477e9894e8c7c170ce4b)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:58.836977 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c6eb32-a3c0-4177-9298-28e64316d30f None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:58.839734 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 95/196] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jul 15 20:36:58 2022] GET /identity/v3/projects/05cc472462c7477e9894e8c7c170ce4b => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:36:58.844023 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c14d0e-4719-4aad-8e37-dbb4074aba49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:58.844023 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c14d0e-4719-4aad-8e37-dbb4074aba49 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:58.844023 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c14d0e-4719-4aad-8e37-dbb4074aba49 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:58.844641 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c14d0e-4719-4aad-8e37-dbb4074aba49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:58.845499 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c6eb32-a3c0-4177-9298-28e64316d30f None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:58.854422 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:58.918307 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:58.991771 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c6eb32-a3c0-4177-9298-28e64316d30f None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:58.993160 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c14d0e-4719-4aad-8e37-dbb4074aba49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:58.994680 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c14d0e-4719-4aad-8e37-dbb4074aba49 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:59.046771 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac6da0b-95c9-4208-a3f3-7641506cde00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:59.047472 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6da0b-95c9-4208-a3f3-7641506cde00 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:59.047756 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6da0b-95c9-4208-a3f3-7641506cde00 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:59.050166 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6da0b-95c9-4208-a3f3-7641506cde00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:59.051022 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac6da0b-95c9-4208-a3f3-7641506cde00 None admin] RBAC: Adding query filter params (role.id=cbcae224848142ce888ca5b84abfd18e, scope.project.id=05cc472462c7477e9894e8c7c170ce4b, user.id=240ef4c3a71c4a96adfacb933f4793ec) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:36:59.051342 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac6da0b-95c9-4208-a3f3-7641506cde00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:59.053685 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac6da0b-95c9-4208-a3f3-7641506cde00 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:59.066710 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 96/197] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jul 15 20:36:58 2022] GET /identity/v3/role_assignments?user.id=240ef4c3a71c4a96adfacb933f4793ec&scope.project.id=05cc472462c7477e9894e8c7c170ce4b&role.id=cbcae224848142ce888ca5b84abfd18e => generated 259 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:36:59.161514 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 102/198] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jul 15 20:36:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 20:36:59.168152 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac6da0b-95c9-4208-a3f3-7641506cde00 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:59.316127 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac6da0b-95c9-4208-a3f3-7641506cde00 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:59.318226 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:59.364182 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e4c368-a8c3-4167-b892-27f7fc61413a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:59.365052 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4c368-a8c3-4167-b892-27f7fc61413a None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:59.365334 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4c368-a8c3-4167-b892-27f7fc61413a None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:59.365615 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4c368-a8c3-4167-b892-27f7fc61413a None admin] PATH_INFO: `/v3/projects/05cc472462c7477e9894e8c7c170ce4b` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:59.366818 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e4c368-a8c3-4167-b892-27f7fc61413a None admin] RBAC: Authorizing `identity:get_project(project_id=05cc472462c7477e9894e8c7c170ce4b)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:59.368378 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e4c368-a8c3-4167-b892-27f7fc61413a None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:59.370451 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 97/199] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jul 15 20:36:59 2022] GET /identity/v3/projects/05cc472462c7477e9894e8c7c170ce4b => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:36:59.377942 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c14d0e-4719-4aad-8e37-dbb4074aba49 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:59.427234 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:59.515448 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c14d0e-4719-4aad-8e37-dbb4074aba49 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:59.553232 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c73099-5290-458b-b882-7dcbe04d426d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:59.554286 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c73099-5290-458b-b882-7dcbe04d426d None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:59.554773 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c73099-5290-458b-b882-7dcbe04d426d None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:59.555276 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c73099-5290-458b-b882-7dcbe04d426d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:59.556308 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c73099-5290-458b-b882-7dcbe04d426d None admin] RBAC: Adding query filter params (role.id=7deae0ce5d074f488024c63c8ce63928, scope.project.id=05cc472462c7477e9894e8c7c170ce4b, user.id=240ef4c3a71c4a96adfacb933f4793ec) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:36:59.556837 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c73099-5290-458b-b882-7dcbe04d426d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:59.558532 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c73099-5290-458b-b882-7dcbe04d426d None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:59.565172 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 103/200] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jul 15 20:36:59 2022] GET /identity/v3/role_assignments?user.id=240ef4c3a71c4a96adfacb933f4793ec&scope.project.id=05cc472462c7477e9894e8c7c170ce4b&role.id=7deae0ce5d074f488024c63c8ce63928 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:36:59.657009 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cbbaee-61d3-4f94-94d2-e850ed72d906 None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:59.657299 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cbbaee-61d3-4f94-94d2-e850ed72d906 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:59.657515 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cbbaee-61d3-4f94-94d2-e850ed72d906 None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:59.659270 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 98/201] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:36:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:36:59.665317 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d36ad14-c949-463d-a584-fca9560b7d98 None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:59.665965 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d36ad14-c949-463d-a584-fca9560b7d98 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:59.666480 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d36ad14-c949-463d-a584-fca9560b7d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:59.696620 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-1d36ad14-c949-463d-a584-fca9560b7d98 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:59.698260 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-1d36ad14-c949-463d-a584-fca9560b7d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:59.795820 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 104/202] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:36:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:36:59.822028 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cbbaee-61d3-4f94-94d2-e850ed72d906 None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:59.947710 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cbbaee-61d3-4f94-94d2-e850ed72d906 None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:59.982330 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0fa240-fedc-4237-8a51-78b5f74ae3e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:59.983131 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0fa240-fedc-4237-8a51-78b5f74ae3e0 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:59.983417 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0fa240-fedc-4237-8a51-78b5f74ae3e0 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:59.983693 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0fa240-fedc-4237-8a51-78b5f74ae3e0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:59.994924 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0fa240-fedc-4237-8a51-78b5f74ae3e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:37:00.003092 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-7b0fa240-fedc-4237-8a51-78b5f74ae3e0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 20:37:00.003092 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:00.003092 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:00.003092 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:00.003092 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:00.003092 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:00.003092 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:00.003092 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:00.003092 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:00.003092 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:00.003092 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:00.003092 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:00.003092 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:37:00.003092 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:37:00.003092 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:37:00.003092 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:37:00.003956 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:37:00.003956 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:37:00.003956 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:37:00.003956 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:37:00.003956 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:00.003956 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:00.003956 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:00.003956 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:00.003956 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:00.003956 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:00.003956 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:00.003956 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:00.003956 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:00.003956 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:00.003956 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:00.003956 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:00.005132 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:00.005132 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:00.005132 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:00.005132 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:00.005132 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:37:00.005132 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:37:00.005132 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:37:00.005132 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:37:00.005132 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:37:00.005132 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:37:00.005132 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 20:37:00.005132 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:37:00.005132 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 99/203] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jul 15 20:36:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:37:00.010008 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d36ad14-c949-463d-a584-fca9560b7d98 None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:00.049635 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:00.127514 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d36ad14-c949-463d-a584-fca9560b7d98 None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:00.181102 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6410a36a-9e55-432e-9657-be02d73b6fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:00.181782 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6410a36a-9e55-432e-9657-be02d73b6fba None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:00.182056 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6410a36a-9e55-432e-9657-be02d73b6fba None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:00.182371 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6410a36a-9e55-432e-9657-be02d73b6fba None admin] PATH_INFO: `/v3/roles` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:00.183123 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6410a36a-9e55-432e-9657-be02d73b6fba None admin] RBAC: Adding query filter params (name=reader) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:00.183431 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6410a36a-9e55-432e-9657-be02d73b6fba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:00.184824 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6410a36a-9e55-432e-9657-be02d73b6fba None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:00.193835 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 105/204] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Jul 15 20:37:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:00.199634 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0fa240-fedc-4237-8a51-78b5f74ae3e0 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:00.233273 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:00.306773 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0fa240-fedc-4237-8a51-78b5f74ae3e0 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:00.343183 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accdd98d-54e2-49ab-8c37-e5bf4d09dfb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:00.344076 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accdd98d-54e2-49ab-8c37-e5bf4d09dfb7 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:00.344358 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accdd98d-54e2-49ab-8c37-e5bf4d09dfb7 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:00.344635 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accdd98d-54e2-49ab-8c37-e5bf4d09dfb7 None admin] PATH_INFO: `/v3/users/978d6e4088c54f40980db9bee13bed32` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:00.345838 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accdd98d-54e2-49ab-8c37-e5bf4d09dfb7 None admin] RBAC: Authorizing `identity:get_user(user_id=978d6e4088c54f40980db9bee13bed32)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:00.347341 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accdd98d-54e2-49ab-8c37-e5bf4d09dfb7 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:00.349221 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 100/205] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jul 15 20:37:00 2022] GET /identity/v3/users/978d6e4088c54f40980db9bee13bed32 => generated 289 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:00.354482 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6410a36a-9e55-432e-9657-be02d73b6fba None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:00.486565 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:00.497571 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6410a36a-9e55-432e-9657-be02d73b6fba None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:00.548546 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89e56d1-8bc9-47dc-a5ed-ac84d5ac3097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:00.549328 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e56d1-8bc9-47dc-a5ed-ac84d5ac3097 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:00.549616 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e56d1-8bc9-47dc-a5ed-ac84d5ac3097 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:00.549893 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e56d1-8bc9-47dc-a5ed-ac84d5ac3097 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:00.645494 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89e56d1-8bc9-47dc-a5ed-ac84d5ac3097 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:00.646981 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89e56d1-8bc9-47dc-a5ed-ac84d5ac3097 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:00.779720 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:00.792093 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 106/206] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jul 15 20:37:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:00.797674 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accdd98d-54e2-49ab-8c37-e5bf4d09dfb7 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:00.899332 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:00.902899 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accdd98d-54e2-49ab-8c37-e5bf4d09dfb7 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:00.939050 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34aa851-3eb1-444e-a070-88de05a137d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:00.939919 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34aa851-3eb1-444e-a070-88de05a137d2 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:00.940206 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34aa851-3eb1-444e-a070-88de05a137d2 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:00.940484 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34aa851-3eb1-444e-a070-88de05a137d2 None admin] PATH_INFO: `/v3/projects/ce682a869504492d931a06b90986fa49` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:00.941695 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34aa851-3eb1-444e-a070-88de05a137d2 None admin] RBAC: Authorizing `identity:get_project(project_id=ce682a869504492d931a06b90986fa49)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:00.943191 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34aa851-3eb1-444e-a070-88de05a137d2 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:00.945467 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 101/207] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jul 15 20:37:00 2022] GET /identity/v3/projects/ce682a869504492d931a06b90986fa49 => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:00.951318 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89e56d1-8bc9-47dc-a5ed-ac84d5ac3097 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:01.061884 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89e56d1-8bc9-47dc-a5ed-ac84d5ac3097 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:01.105324 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eb626a-5f99-4143-a90c-39372aba3485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:01.105985 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb626a-5f99-4143-a90c-39372aba3485 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:01.106334 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb626a-5f99-4143-a90c-39372aba3485 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:01.106612 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb626a-5f99-4143-a90c-39372aba3485 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:01.107441 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eb626a-5f99-4143-a90c-39372aba3485 None admin] RBAC: Adding query filter params (role.id=e2a7ac9ae1fe4d4b988ae2dc2c8ab021, scope.project.id=ce682a869504492d931a06b90986fa49, user.id=978d6e4088c54f40980db9bee13bed32) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:01.107809 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eb626a-5f99-4143-a90c-39372aba3485 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:01.109272 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eb626a-5f99-4143-a90c-39372aba3485 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:01.118829 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 107/208] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jul 15 20:37:00 2022] GET /identity/v3/role_assignments?user.id=978d6e4088c54f40980db9bee13bed32&scope.project.id=ce682a869504492d931a06b90986fa49&role.id=e2a7ac9ae1fe4d4b988ae2dc2c8ab021 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:01.161311 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e97cb-c087-4987-a721-be53f1041f00 None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:01.161815 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e97cb-c087-4987-a721-be53f1041f00 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:01.161887 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e97cb-c087-4987-a721-be53f1041f00 None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:01.163302 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 102/209] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:37:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:37:01.180148 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a645b4c3-e16d-4459-98d1-850b27a84369 None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:01.180440 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a645b4c3-e16d-4459-98d1-850b27a84369 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:01.180720 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a645b4c3-e16d-4459-98d1-850b27a84369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:01.204149 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-a645b4c3-e16d-4459-98d1-850b27a84369 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:01.205356 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-a645b4c3-e16d-4459-98d1-850b27a84369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:01.264029 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:01.279700 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 108/210] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:37:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:37:01.321482 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3e97cb-c087-4987-a721-be53f1041f00 None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:01.460019 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3e97cb-c087-4987-a721-be53f1041f00 None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:01.504272 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb13a2ff-8b4d-4f96-b3e1-7bd87c1b8916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:01.505485 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13a2ff-8b4d-4f96-b3e1-7bd87c1b8916 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:01.505974 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13a2ff-8b4d-4f96-b3e1-7bd87c1b8916 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:01.506489 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13a2ff-8b4d-4f96-b3e1-7bd87c1b8916 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:01.524781 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb13a2ff-8b4d-4f96-b3e1-7bd87c1b8916 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:37:01.533150 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-cb13a2ff-8b4d-4f96-b3e1-7bd87c1b8916 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 20:37:01.533150 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:01.533150 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:01.533150 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:01.533150 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:01.533150 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:01.533150 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:01.533150 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:01.533150 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:01.533150 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:01.533150 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:01.533150 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:01.533150 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:37:01.533150 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:37:01.533150 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:37:01.533150 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:37:01.534146 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:37:01.534146 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:37:01.534146 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:37:01.534146 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:37:01.534146 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:01.534146 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:01.534146 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:01.534146 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:01.534146 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:01.534146 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:01.534146 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:01.534146 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:01.534146 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:01.534146 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:01.534146 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:01.534146 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:01.534931 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:01.534931 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:01.534931 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:01.534931 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:01.534931 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:37:01.534931 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:37:01.534931 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:37:01.534931 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:37:01.534931 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:37:01.534931 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:37:01.534931 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 20:37:01.534931 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:37:01.539439 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 103/211] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jul 15 20:37:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:37:01.544925 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a645b4c3-e16d-4459-98d1-850b27a84369 None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:01.667118 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a645b4c3-e16d-4459-98d1-850b27a84369 None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:01.692828 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d8a35b-1cac-4cdb-8bd9-ddf495dba4da None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:01.693479 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d8a35b-1cac-4cdb-8bd9-ddf495dba4da None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:01.693957 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d8a35b-1cac-4cdb-8bd9-ddf495dba4da None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:01.695815 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 104/212] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:37:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 20:37:01.701387 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67beaa82-1954-4f85-b27a-7eff0fbe7a17 None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:01.701822 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67beaa82-1954-4f85-b27a-7eff0fbe7a17 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:01.702309 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67beaa82-1954-4f85-b27a-7eff0fbe7a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:01.721616 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2473b20a-2005-4c6f-8581-955b0f2795c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:01.722338 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2473b20a-2005-4c6f-8581-955b0f2795c9 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:01.722628 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2473b20a-2005-4c6f-8581-955b0f2795c9 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:01.722908 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2473b20a-2005-4c6f-8581-955b0f2795c9 None admin] PATH_INFO: `/v3/roles` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:01.723663 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2473b20a-2005-4c6f-8581-955b0f2795c9 None admin] RBAC: Adding query filter params (name=member) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:01.723974 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2473b20a-2005-4c6f-8581-955b0f2795c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:01.725370 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2473b20a-2005-4c6f-8581-955b0f2795c9 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:01.727176 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-67beaa82-1954-4f85-b27a-7eff0fbe7a17 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:01.728483 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-67beaa82-1954-4f85-b27a-7eff0fbe7a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:01.734529 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 109/213] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Jul 15 20:37:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:01.743685 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2473b20a-2005-4c6f-8581-955b0f2795c9 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:01.756681 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:01.810552 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:01.818813 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 105/214] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:37:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 20:37:01.845492 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67beaa82-1954-4f85-b27a-7eff0fbe7a17 None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:01.868184 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2473b20a-2005-4c6f-8581-955b0f2795c9 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:01.916476 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5aba2e-62d1-4293-8b5b-a0aafca242c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:01.917942 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5aba2e-62d1-4293-8b5b-a0aafca242c1 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:01.918401 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5aba2e-62d1-4293-8b5b-a0aafca242c1 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:01.919422 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5aba2e-62d1-4293-8b5b-a0aafca242c1 None admin] PATH_INFO: `/v3/users/b0caf686ab3b4cbf8b38e1d67924962f` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:01.939057 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5aba2e-62d1-4293-8b5b-a0aafca242c1 None admin] RBAC: Authorizing `identity:get_user(user_id=b0caf686ab3b4cbf8b38e1d67924962f)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:01.940821 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5aba2e-62d1-4293-8b5b-a0aafca242c1 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:01.943597 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 110/215] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jul 15 20:37:01 2022] GET /identity/v3/users/b0caf686ab3b4cbf8b38e1d67924962f => generated 297 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:01.950206 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5aba2e-62d1-4293-8b5b-a0aafca242c1 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:01.958997 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67beaa82-1954-4f85-b27a-7eff0fbe7a17 None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:01.997534 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707daab2-00b2-475a-82b0-3dea60442850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:01.998372 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707daab2-00b2-475a-82b0-3dea60442850 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:01.998656 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707daab2-00b2-475a-82b0-3dea60442850 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:01.998933 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707daab2-00b2-475a-82b0-3dea60442850 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:02.000663 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707daab2-00b2-475a-82b0-3dea60442850 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:02.002132 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707daab2-00b2-475a-82b0-3dea60442850 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:02.003753 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 106/216] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jul 15 20:37:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:37:02.003753 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c06441-795f-4b60-8fe9-739d5cdb3db9 None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:02.003753 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c06441-795f-4b60-8fe9-739d5cdb3db9 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:02.003753 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c06441-795f-4b60-8fe9-739d5cdb3db9 None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:02.003753 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 107/217] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:37:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:37:02.008888 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c06441-795f-4b60-8fe9-739d5cdb3db9 None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:02.034573 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:02.076357 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5aba2e-62d1-4293-8b5b-a0aafca242c1 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:02.087864 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:02.117804 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c3b330-eff9-40c4-badc-0bfbcb3828d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:02.118590 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c3b330-eff9-40c4-badc-0bfbcb3828d4 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:02.118793 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c3b330-eff9-40c4-badc-0bfbcb3828d4 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:02.119055 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c3b330-eff9-40c4-badc-0bfbcb3828d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:02.122477 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c06441-795f-4b60-8fe9-739d5cdb3db9 None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:02.159302 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08df30e7-ebaa-4fd7-beb9-145a3c130024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:02.159977 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df30e7-ebaa-4fd7-beb9-145a3c130024 None admin] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:02.160269 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df30e7-ebaa-4fd7-beb9-145a3c130024 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:02.160544 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df30e7-ebaa-4fd7-beb9-145a3c130024 None admin] PATH_INFO: `/v3/users` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:02.161262 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08df30e7-ebaa-4fd7-beb9-145a3c130024 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:02.162739 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08df30e7-ebaa-4fd7-beb9-145a3c130024 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:02.184945 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 108/218] 10.222.0.16 () {60 vars in 1132 bytes} [Fri Jul 15 20:37:02 2022] POST /identity/v3/users => generated 297 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 20:37:02.184945 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4747983-983d-496a-a47e-9e3cee798c2f None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:02.184945 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4747983-983d-496a-a47e-9e3cee798c2f None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:02.184945 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4747983-983d-496a-a47e-9e3cee798c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:02.203472 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c3b330-eff9-40c4-badc-0bfbcb3828d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:02.205244 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c3b330-eff9-40c4-badc-0bfbcb3828d4 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:02.205694 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-d4747983-983d-496a-a47e-9e3cee798c2f None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:02.206967 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-d4747983-983d-496a-a47e-9e3cee798c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:02.288800 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 109/219] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:37:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:37:02.313069 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4747983-983d-496a-a47e-9e3cee798c2f None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:02.327501 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:02.352493 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 111/220] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jul 15 20:37:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 15 20:37:02.358149 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c3b330-eff9-40c4-badc-0bfbcb3828d4 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:02.369350 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:02.448764 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4747983-983d-496a-a47e-9e3cee798c2f None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:02.488356 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c3b330-eff9-40c4-badc-0bfbcb3828d4 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:02.491513 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b005645c-a1f3-4f65-b702-20af71c90440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:02.492528 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b005645c-a1f3-4f65-b702-20af71c90440 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:02.492813 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b005645c-a1f3-4f65-b702-20af71c90440 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:02.493094 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b005645c-a1f3-4f65-b702-20af71c90440 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:02.506777 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b005645c-a1f3-4f65-b702-20af71c90440 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:37:02.514647 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-b005645c-a1f3-4f65-b702-20af71c90440 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:37:02.514647 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:02.514647 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:02.514647 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:02.514647 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:02.514647 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:02.514647 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:02.514647 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:02.514647 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:02.514647 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:02.514647 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:02.514647 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:02.514647 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:37:02.514647 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:37:02.514647 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:37:02.514647 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:37:02.516064 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:37:02.516064 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:37:02.516064 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:37:02.516064 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:37:02.516064 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:02.516064 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:02.516064 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:02.516064 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:02.516064 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:02.516064 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:02.516064 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:02.516064 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:02.516064 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:02.516064 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:02.516064 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:02.516064 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:02.518257 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:02.518257 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:02.518257 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:02.518257 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:02.518257 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:37:02.518257 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:37:02.518257 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:37:02.518257 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:37:02.518257 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:37:02.518257 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:37:02.518257 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:37:02.518257 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:37:02.518257 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 110/221] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Jul 15 20:37:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 20:37:02.518892 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a8d45c-affa-454e-abb8-a636df6adbba None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:02.518963 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a8d45c-affa-454e-abb8-a636df6adbba None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:02.520277 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a8d45c-affa-454e-abb8-a636df6adbba None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:02.520514 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 111/222] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:37:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:37:02.522761 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a8d45c-affa-454e-abb8-a636df6adbba None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:02.534584 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d146bf52-4f3d-4a31-94e0-0af792fe690b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:02.535516 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d146bf52-4f3d-4a31-94e0-0af792fe690b None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:02.535876 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d146bf52-4f3d-4a31-94e0-0af792fe690b None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:02.536167 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d146bf52-4f3d-4a31-94e0-0af792fe690b None admin] PATH_INFO: `/v3/projects/05cc472462c7477e9894e8c7c170ce4b` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:02.537496 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d146bf52-4f3d-4a31-94e0-0af792fe690b None admin] RBAC: Authorizing `identity:get_project(project_id=05cc472462c7477e9894e8c7c170ce4b)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:02.539014 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d146bf52-4f3d-4a31-94e0-0af792fe690b None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:02.544337 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 112/223] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jul 15 20:37:02 2022] GET /identity/v3/projects/05cc472462c7477e9894e8c7c170ce4b => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:37:02.544337 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de553f-a17f-4ea6-a73d-68778d184a2f None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:02.544337 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de553f-a17f-4ea6-a73d-68778d184a2f None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:02.544337 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de553f-a17f-4ea6-a73d-68778d184a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:02.564674 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-55de553f-a17f-4ea6-a73d-68778d184a2f None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:02.565895 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-55de553f-a17f-4ea6-a73d-68778d184a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:02.620955 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:02.657362 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 113/224] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:37:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:37:02.658260 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55de553f-a17f-4ea6-a73d-68778d184a2f None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:02.659971 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a8d45c-affa-454e-abb8-a636df6adbba None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:02.675577 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:02.716469 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c836e930-e472-4248-9b11-17b6053c4b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:02.717067 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836e930-e472-4248-9b11-17b6053c4b9b None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:02.717359 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836e930-e472-4248-9b11-17b6053c4b9b None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:02.717769 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836e930-e472-4248-9b11-17b6053c4b9b None admin] PATH_INFO: `/v3/roles` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:02.718589 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c836e930-e472-4248-9b11-17b6053c4b9b None admin] RBAC: Adding query filter params (name=admin) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:02.718907 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c836e930-e472-4248-9b11-17b6053c4b9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:02.720432 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c836e930-e472-4248-9b11-17b6053c4b9b None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:02.734888 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 112/225] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jul 15 20:37:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:02.736017 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c836e930-e472-4248-9b11-17b6053c4b9b None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:02.790570 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55de553f-a17f-4ea6-a73d-68778d184a2f None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:02.835258 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f50fb87-963d-4eed-8a84-290de9bf1c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:02.836161 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f50fb87-963d-4eed-8a84-290de9bf1c8f None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:02.836450 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f50fb87-963d-4eed-8a84-290de9bf1c8f None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:02.836762 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f50fb87-963d-4eed-8a84-290de9bf1c8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:02.837623 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f50fb87-963d-4eed-8a84-290de9bf1c8f None admin] RBAC: Adding query filter params (role.id=478906d6337444e68ea74da908d9a24d, scope.project.id=05cc472462c7477e9894e8c7c170ce4b, user.id=b0caf686ab3b4cbf8b38e1d67924962f) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:02.837948 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f50fb87-963d-4eed-8a84-290de9bf1c8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:02.839815 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f50fb87-963d-4eed-8a84-290de9bf1c8f None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:02.845867 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 114/226] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jul 15 20:37:02 2022] GET /identity/v3/role_assignments?user.id=b0caf686ab3b4cbf8b38e1d67924962f&scope.project.id=05cc472462c7477e9894e8c7c170ce4b&role.id=478906d6337444e68ea74da908d9a24d => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:02.846852 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f50fb87-963d-4eed-8a84-290de9bf1c8f None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:02.858897 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c836e930-e472-4248-9b11-17b6053c4b9b None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:02.900133 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:02.916032 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781b9ad5-d95b-4b25-8169-d375a5051824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:02.918138 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781b9ad5-d95b-4b25-8169-d375a5051824 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:02.919914 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781b9ad5-d95b-4b25-8169-d375a5051824 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:02.920312 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781b9ad5-d95b-4b25-8169-d375a5051824 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:02.943132 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781b9ad5-d95b-4b25-8169-d375a5051824 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:37:02.945936 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:02.960004 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-781b9ad5-d95b-4b25-8169-d375a5051824 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 20:37:02.960004 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:02.960004 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:02.960004 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:02.960004 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:02.960004 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:02.960004 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:02.960004 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:02.960004 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:02.960004 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:02.960004 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:02.960004 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:02.960004 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:37:02.960004 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:37:02.960004 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:37:02.960004 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:37:02.961314 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:37:02.961314 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:37:02.961314 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:37:02.961314 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:37:02.961314 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:02.961314 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:02.961314 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:02.961314 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:02.961314 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:02.961314 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:02.961314 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:02.961314 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:02.961314 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:02.961314 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:02.961314 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:02.961314 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:02.962295 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:02.962295 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:02.962295 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:02.962295 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:02.962295 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:37:02.962295 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:37:02.962295 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:37:02.962295 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:37:02.962295 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:37:02.962295 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:37:02.962295 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 20:37:02.962295 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:37:02.962295 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 113/227] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Jul 15 20:37:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:37:02.969071 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781b9ad5-d95b-4b25-8169-d375a5051824 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:02.987082 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f50fb87-963d-4eed-8a84-290de9bf1c8f None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:03.029328 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19f323c-7d47-48e7-9633-d08457cff991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:03.030279 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f323c-7d47-48e7-9633-d08457cff991 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:03.030572 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f323c-7d47-48e7-9633-d08457cff991 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:03.030863 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f323c-7d47-48e7-9633-d08457cff991 None admin] PATH_INFO: `/v3/users/240ef4c3a71c4a96adfacb933f4793ec` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:03.033044 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19f323c-7d47-48e7-9633-d08457cff991 None admin] RBAC: Authorizing `identity:get_user(user_id=240ef4c3a71c4a96adfacb933f4793ec)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:03.036648 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19f323c-7d47-48e7-9633-d08457cff991 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:03.039841 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 115/228] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jul 15 20:37:02 2022] GET /identity/v3/users/240ef4c3a71c4a96adfacb933f4793ec => generated 283 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:03.048332 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19f323c-7d47-48e7-9633-d08457cff991 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:03.140057 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781b9ad5-d95b-4b25-8169-d375a5051824 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:03.178517 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e2d1a9-9560-4ab3-a068-2e3c4fa954d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:03.179269 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2d1a9-9560-4ab3-a068-2e3c4fa954d5 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:03.179485 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2d1a9-9560-4ab3-a068-2e3c4fa954d5 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:03.179940 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2d1a9-9560-4ab3-a068-2e3c4fa954d5 None admin] PATH_INFO: `/v3/roles` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:03.180701 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e2d1a9-9560-4ab3-a068-2e3c4fa954d5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:03.181013 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e2d1a9-9560-4ab3-a068-2e3c4fa954d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:03.182422 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e2d1a9-9560-4ab3-a068-2e3c4fa954d5 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:03.193004 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 114/229] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jul 15 20:37:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:03.198695 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e2d1a9-9560-4ab3-a068-2e3c4fa954d5 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:03.266337 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:03.315718 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19f323c-7d47-48e7-9633-d08457cff991 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:03.318469 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e2d1a9-9560-4ab3-a068-2e3c4fa954d5 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:03.375635 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ec8184-896e-4eec-987f-4f4916b4d412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:03.376526 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ec8184-896e-4eec-987f-4f4916b4d412 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:03.376818 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ec8184-896e-4eec-987f-4f4916b4d412 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:03.377102 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ec8184-896e-4eec-987f-4f4916b4d412 None admin] PATH_INFO: `/v3/projects/05cc472462c7477e9894e8c7c170ce4b` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:03.378557 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ec8184-896e-4eec-987f-4f4916b4d412 None admin] RBAC: Authorizing `identity:get_project(project_id=05cc472462c7477e9894e8c7c170ce4b)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:03.380101 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ec8184-896e-4eec-987f-4f4916b4d412 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:03.382210 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 116/230] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jul 15 20:37:03 2022] GET /identity/v3/projects/05cc472462c7477e9894e8c7c170ce4b => generated 302 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:03.383003 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103e3419-14a3-4500-a8bb-51419cdfd8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:03.384159 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e3419-14a3-4500-a8bb-51419cdfd8dd None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:03.384639 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e3419-14a3-4500-a8bb-51419cdfd8dd None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:03.385107 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e3419-14a3-4500-a8bb-51419cdfd8dd None admin] PATH_INFO: `/v3/users/240ef4c3a71c4a96adfacb933f4793ec` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:03.387491 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103e3419-14a3-4500-a8bb-51419cdfd8dd None admin] RBAC: Authorizing `identity:get_user(user_id=240ef4c3a71c4a96adfacb933f4793ec)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:03.387970 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ec8184-896e-4eec-987f-4f4916b4d412 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:03.389460 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103e3419-14a3-4500-a8bb-51419cdfd8dd None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:03.395726 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 115/231] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jul 15 20:37:03 2022] GET /identity/v3/users/240ef4c3a71c4a96adfacb933f4793ec => generated 283 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:37:03.396804 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:03.401729 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103e3419-14a3-4500-a8bb-51419cdfd8dd None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:03.518820 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103e3419-14a3-4500-a8bb-51419cdfd8dd None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:03.547552 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:03.560949 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee65339-626e-4dc5-83a8-7ff515eb5d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:03.562197 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee65339-626e-4dc5-83a8-7ff515eb5d3c None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:03.562763 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee65339-626e-4dc5-83a8-7ff515eb5d3c None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:03.563253 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee65339-626e-4dc5-83a8-7ff515eb5d3c None admin] PATH_INFO: `/v3/projects/05cc472462c7477e9894e8c7c170ce4b` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:03.564873 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee65339-626e-4dc5-83a8-7ff515eb5d3c None admin] RBAC: Authorizing `identity:get_project(project_id=05cc472462c7477e9894e8c7c170ce4b)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:03.566582 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee65339-626e-4dc5-83a8-7ff515eb5d3c None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:03.568502 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 116/232] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jul 15 20:37:03 2022] GET /identity/v3/projects/05cc472462c7477e9894e8c7c170ce4b => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:37:03.579778 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee65339-626e-4dc5-83a8-7ff515eb5d3c None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:03.583850 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ec8184-896e-4eec-987f-4f4916b4d412 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:03.647943 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3638a85c-b870-4d81-907b-21c241a35c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:03.648963 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638a85c-b870-4d81-907b-21c241a35c5f None admin] REQUEST_METHOD: `PUT` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:03.649332 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638a85c-b870-4d81-907b-21c241a35c5f None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:03.649659 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638a85c-b870-4d81-907b-21c241a35c5f None admin] PATH_INFO: `/v3/projects/05cc472462c7477e9894e8c7c170ce4b/users/240ef4c3a71c4a96adfacb933f4793ec/roles/cbcae224848142ce888ca5b84abfd18e` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:03.651861 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3638a85c-b870-4d81-907b-21c241a35c5f None admin] RBAC: Authorizing `identity:create_grant(project_id=05cc472462c7477e9894e8c7c170ce4b, user_id=240ef4c3a71c4a96adfacb933f4793ec, role_id=cbcae224848142ce888ca5b84abfd18e)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:03.654104 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3638a85c-b870-4d81-907b-21c241a35c5f None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:03.693943 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee65339-626e-4dc5-83a8-7ff515eb5d3c None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:03.699106 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 117/233] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Jul 15 20:37:03 2022] PUT /identity/v3/projects/05cc472462c7477e9894e8c7c170ce4b/users/240ef4c3a71c4a96adfacb933f4793ec/roles/cbcae224848142ce888ca5b84abfd18e => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:37:03.761939 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f372af61-5fb0-4c35-830e-4115243aae69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:03.763388 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f372af61-5fb0-4c35-830e-4115243aae69 None admin] REQUEST_METHOD: `PUT` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:03.763889 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f372af61-5fb0-4c35-830e-4115243aae69 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:03.764368 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f372af61-5fb0-4c35-830e-4115243aae69 None admin] PATH_INFO: `/v3/projects/05cc472462c7477e9894e8c7c170ce4b/users/240ef4c3a71c4a96adfacb933f4793ec/roles/7deae0ce5d074f488024c63c8ce63928` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:03.767439 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f372af61-5fb0-4c35-830e-4115243aae69 None admin] RBAC: Authorizing `identity:create_grant(project_id=05cc472462c7477e9894e8c7c170ce4b, user_id=240ef4c3a71c4a96adfacb933f4793ec, role_id=7deae0ce5d074f488024c63c8ce63928)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:03.775281 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f372af61-5fb0-4c35-830e-4115243aae69 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:03.798709 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 117/234] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Jul 15 20:37:03 2022] PUT /identity/v3/projects/05cc472462c7477e9894e8c7c170ce4b/users/240ef4c3a71c4a96adfacb933f4793ec/roles/7deae0ce5d074f488024c63c8ce63928 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 20:37:04.857906 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da28cc1b-ebc4-4006-8723-b7c6c871d729 None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:04.858424 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da28cc1b-ebc4-4006-8723-b7c6c871d729 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:04.858683 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da28cc1b-ebc4-4006-8723-b7c6c871d729 None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:04.860059 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 118/235] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:37:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:37:04.865411 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d106e521-be68-44af-9ab5-e777083c9422 None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:04.865810 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d106e521-be68-44af-9ab5-e777083c9422 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:04.865989 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d106e521-be68-44af-9ab5-e777083c9422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:04.883547 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-d106e521-be68-44af-9ab5-e777083c9422 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:04.884738 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-d106e521-be68-44af-9ab5-e777083c9422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:04.950488 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:04.976078 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 118/236] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:37:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:37:05.000262 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da28cc1b-ebc4-4006-8723-b7c6c871d729 None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:05.086679 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:05.129426 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da28cc1b-ebc4-4006-8723-b7c6c871d729 None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:05.164133 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7994ece5-c52c-41ab-9e90-8bce70341f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:05.164938 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7994ece5-c52c-41ab-9e90-8bce70341f34 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:05.165227 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7994ece5-c52c-41ab-9e90-8bce70341f34 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:05.165507 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7994ece5-c52c-41ab-9e90-8bce70341f34 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:05.176663 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7994ece5-c52c-41ab-9e90-8bce70341f34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:37:05.184410 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-7994ece5-c52c-41ab-9e90-8bce70341f34 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 20:37:05.184410 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:05.184410 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:05.184410 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:05.184410 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:05.184410 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:05.184410 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:05.184410 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:05.184410 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:05.184410 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:05.184410 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:05.184410 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:05.184410 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:37:05.184410 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:37:05.184410 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:37:05.184410 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:37:05.185266 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:37:05.185266 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:37:05.185266 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:37:05.185266 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:37:05.185266 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:05.185266 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:05.185266 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:05.185266 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:05.185266 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:05.185266 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:05.185266 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:05.185266 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:05.185266 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:05.185266 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:05.185266 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:05.185266 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:05.186066 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:05.186066 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:05.186066 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:05.186066 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:05.186066 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:37:05.186066 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:37:05.186066 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:37:05.186066 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:37:05.186066 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:37:05.186066 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:37:05.186066 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 20:37:05.186066 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:37:05.186066 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 119/237] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jul 15 20:37:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:37:05.192004 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d106e521-be68-44af-9ab5-e777083c9422 None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:05.266637 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781247e-a288-4d5a-ac23-640c3c8e054e None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:05.266974 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781247e-a288-4d5a-ac23-640c3c8e054e None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:05.267211 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781247e-a288-4d5a-ac23-640c3c8e054e None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:05.268594 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 120/238] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:37:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 20:37:05.279901 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf2de13-2737-4e97-95c7-8011ea860a2c None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:05.280185 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf2de13-2737-4e97-95c7-8011ea860a2c None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:05.280466 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf2de13-2737-4e97-95c7-8011ea860a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:05.310998 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-ebf2de13-2737-4e97-95c7-8011ea860a2c None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:05.312254 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-ebf2de13-2737-4e97-95c7-8011ea860a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:05.357415 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d106e521-be68-44af-9ab5-e777083c9422 None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:05.413404 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 121/239] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:37:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 20:37:05.440909 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf2de13-2737-4e97-95c7-8011ea860a2c None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:05.455826 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38516f86-b199-48f9-9b2d-b3fff5720eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:05.456641 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38516f86-b199-48f9-9b2d-b3fff5720eca None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:05.456824 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38516f86-b199-48f9-9b2d-b3fff5720eca None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:05.457101 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38516f86-b199-48f9-9b2d-b3fff5720eca None admin] PATH_INFO: `/v3/roles` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:05.457852 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38516f86-b199-48f9-9b2d-b3fff5720eca None admin] RBAC: Adding query filter params (name=reader) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:05.458184 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38516f86-b199-48f9-9b2d-b3fff5720eca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:05.459641 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38516f86-b199-48f9-9b2d-b3fff5720eca None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:05.486007 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 119/240] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Jul 15 20:37:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:05.500547 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38516f86-b199-48f9-9b2d-b3fff5720eca None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:05.554171 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf2de13-2737-4e97-95c7-8011ea860a2c None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:05.559781 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:05.602761 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b794e0-b9e4-442e-b72d-97c542e9c78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:05.603562 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b794e0-b9e4-442e-b72d-97c542e9c78a None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:05.603849 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b794e0-b9e4-442e-b72d-97c542e9c78a None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:05.604125 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b794e0-b9e4-442e-b72d-97c542e9c78a None admin] PATH_INFO: `/v3/domains/default` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:05.610181 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b794e0-b9e4-442e-b72d-97c542e9c78a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:05.611723 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b794e0-b9e4-442e-b72d-97c542e9c78a None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:05.613519 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 122/241] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jul 15 20:37:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:05.617691 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:05.622102 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b794e0-b9e4-442e-b72d-97c542e9c78a None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:05.700381 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38516f86-b199-48f9-9b2d-b3fff5720eca None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:05.744228 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f2fad-7c0d-4832-9557-6e5615313c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:05.745581 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f2fad-7c0d-4832-9557-6e5615313c2e None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:05.745869 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f2fad-7c0d-4832-9557-6e5615313c2e None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:05.746428 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f2fad-7c0d-4832-9557-6e5615313c2e None admin] PATH_INFO: `/v3/users/f1410e6bede9401388b7eb6e39d41e2f` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:05.763882 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54f2fad-7c0d-4832-9557-6e5615313c2e None admin] RBAC: Authorizing `identity:get_user(user_id=f1410e6bede9401388b7eb6e39d41e2f)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:05.765393 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54f2fad-7c0d-4832-9557-6e5615313c2e None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:05.767850 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 120/242] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jul 15 20:37:05 2022] GET /identity/v3/users/f1410e6bede9401388b7eb6e39d41e2f => generated 297 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:05.770742 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c5eabf-dec0-4ae3-a983-f7076df4dbc8 None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:05.771028 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c5eabf-dec0-4ae3-a983-f7076df4dbc8 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:05.771317 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c5eabf-dec0-4ae3-a983-f7076df4dbc8 None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:05.773154 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 121/243] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:37:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:37:05.773872 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c5eabf-dec0-4ae3-a983-f7076df4dbc8 None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:05.784844 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b794e0-b9e4-442e-b72d-97c542e9c78a None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:05.828695 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3c87bc-65b4-4ee0-ac52-fe7b95b9227e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:05.829515 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c87bc-65b4-4ee0-ac52-fe7b95b9227e None admin] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:05.829927 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c87bc-65b4-4ee0-ac52-fe7b95b9227e None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:05.830933 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c87bc-65b4-4ee0-ac52-fe7b95b9227e None admin] PATH_INFO: `/v3/users` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:05.831664 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3c87bc-65b4-4ee0-ac52-fe7b95b9227e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:05.833760 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3c87bc-65b4-4ee0-ac52-fe7b95b9227e None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:05.838485 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:05.861045 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 123/244] 10.222.0.16 () {60 vars in 1132 bytes} [Fri Jul 15 20:37:05 2022] POST /identity/v3/users => generated 293 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:37:05.863246 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f115fe5-d622-4788-b169-7e3e64f15107 None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:05.863592 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f115fe5-d622-4788-b169-7e3e64f15107 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:05.863991 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f115fe5-d622-4788-b169-7e3e64f15107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:05.897567 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-2f115fe5-d622-4788-b169-7e3e64f15107 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:05.898833 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-2f115fe5-d622-4788-b169-7e3e64f15107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:05.904929 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:05.913965 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c5eabf-dec0-4ae3-a983-f7076df4dbc8 None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:05.986610 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0ce9fe-98f0-4c82-aa94-166b12ff3e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:05.987191 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ce9fe-98f0-4c82-aa94-166b12ff3e35 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:05.987479 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ce9fe-98f0-4c82-aa94-166b12ff3e35 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:05.987756 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ce9fe-98f0-4c82-aa94-166b12ff3e35 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:06.027696 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 124/245] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:37:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:37:06.063638 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f115fe5-d622-4788-b169-7e3e64f15107 None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:06.111390 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0ce9fe-98f0-4c82-aa94-166b12ff3e35 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:06.112775 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0ce9fe-98f0-4c82-aa94-166b12ff3e35 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:06.205664 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f115fe5-d622-4788-b169-7e3e64f15107 None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:06.226440 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:06.242121 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:06.245829 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 122/246] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jul 15 20:37:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 15 20:37:06.254337 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0ce9fe-98f0-4c82-aa94-166b12ff3e35 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:06.259719 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51baaa87-9220-45be-8692-533a47b1185e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:06.260532 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51baaa87-9220-45be-8692-533a47b1185e None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:06.260821 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51baaa87-9220-45be-8692-533a47b1185e None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:06.261102 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51baaa87-9220-45be-8692-533a47b1185e None admin] PATH_INFO: `/v3/roles/member` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:06.279530 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51baaa87-9220-45be-8692-533a47b1185e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:37:06.290974 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-51baaa87-9220-45be-8692-533a47b1185e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 20:37:06.290974 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:06.290974 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:06.290974 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:06.290974 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:06.290974 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:06.290974 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:06.290974 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:06.290974 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:06.290974 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:06.290974 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:06.290974 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:06.290974 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:37:06.290974 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:37:06.290974 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:37:06.290974 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:37:06.291861 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:37:06.291861 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:37:06.291861 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:37:06.291861 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:37:06.291861 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:06.291861 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:06.291861 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:06.291861 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:06.291861 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:06.291861 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:06.291861 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:06.291861 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:06.291861 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:06.291861 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:06.291861 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:06.291861 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:06.292713 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:06.292713 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:06.292713 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:06.292713 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:06.292713 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:37:06.292713 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:37:06.292713 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:37:06.292713 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:37:06.292713 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:37:06.292713 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:37:06.292713 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 20:37:06.292713 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:37:06.295992 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 125/247] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jul 15 20:37:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 20:37:06.302847 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51baaa87-9220-45be-8692-533a47b1185e None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:06.404465 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0ce9fe-98f0-4c82-aa94-166b12ff3e35 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:06.441154 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51baaa87-9220-45be-8692-533a47b1185e None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:06.448668 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edf5f25-dccc-4ea3-955a-8a9702caab1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:06.455632 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edf5f25-dccc-4ea3-955a-8a9702caab1e None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:06.455924 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edf5f25-dccc-4ea3-955a-8a9702caab1e None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:06.456216 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edf5f25-dccc-4ea3-955a-8a9702caab1e None admin] PATH_INFO: `/v3/projects/05cc472462c7477e9894e8c7c170ce4b` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:06.457553 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edf5f25-dccc-4ea3-955a-8a9702caab1e None admin] RBAC: Authorizing `identity:get_project(project_id=05cc472462c7477e9894e8c7c170ce4b)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:06.459192 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edf5f25-dccc-4ea3-955a-8a9702caab1e None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:06.461951 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 123/248] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jul 15 20:37:06 2022] GET /identity/v3/projects/05cc472462c7477e9894e8c7c170ce4b => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:06.468025 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edf5f25-dccc-4ea3-955a-8a9702caab1e None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:06.489922 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c12d3a-d581-4bea-af23-c17aea015bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:06.491186 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c12d3a-d581-4bea-af23-c17aea015bb3 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:06.492109 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c12d3a-d581-4bea-af23-c17aea015bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:06.492724 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c12d3a-d581-4bea-af23-c17aea015bb3 None admin] PATH_INFO: `/v3/roles` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:06.493728 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c12d3a-d581-4bea-af23-c17aea015bb3 None admin] RBAC: Adding query filter params (name=member) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:06.494487 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c12d3a-d581-4bea-af23-c17aea015bb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:06.496542 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c12d3a-d581-4bea-af23-c17aea015bb3 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:06.510118 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 126/249] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Jul 15 20:37:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:37:06.517469 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c12d3a-d581-4bea-af23-c17aea015bb3 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:06.553809 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:06.564132 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:06.599604 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edf5f25-dccc-4ea3-955a-8a9702caab1e None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:06.651079 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defb4f87-3af3-4d90-bdd6-d5708bfdc98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:06.651746 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb4f87-3af3-4d90-bdd6-d5708bfdc98e None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:06.652035 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb4f87-3af3-4d90-bdd6-d5708bfdc98e None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:06.652466 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb4f87-3af3-4d90-bdd6-d5708bfdc98e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:06.653455 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defb4f87-3af3-4d90-bdd6-d5708bfdc98e None admin] RBAC: Adding query filter params (role.id=e2a7ac9ae1fe4d4b988ae2dc2c8ab021, scope.project.id=05cc472462c7477e9894e8c7c170ce4b, user.id=f1410e6bede9401388b7eb6e39d41e2f) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:06.653829 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defb4f87-3af3-4d90-bdd6-d5708bfdc98e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:06.655884 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defb4f87-3af3-4d90-bdd6-d5708bfdc98e None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:06.664019 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 124/250] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jul 15 20:37:06 2022] GET /identity/v3/role_assignments?user.id=f1410e6bede9401388b7eb6e39d41e2f&scope.project.id=05cc472462c7477e9894e8c7c170ce4b&role.id=e2a7ac9ae1fe4d4b988ae2dc2c8ab021 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:37:06.670126 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62533eb6-bf77-49e5-947f-bc6117a8adcc None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:06.671023 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62533eb6-bf77-49e5-947f-bc6117a8adcc None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:06.673202 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c12d3a-d581-4bea-af23-c17aea015bb3 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:06.673803 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62533eb6-bf77-49e5-947f-bc6117a8adcc None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:06.677348 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 125/251] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:37:06 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:37:06.683869 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61992820-eb24-47cf-a346-d4ffb00db2f0 None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:06.684513 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61992820-eb24-47cf-a346-d4ffb00db2f0 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:06.684992 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61992820-eb24-47cf-a346-d4ffb00db2f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:06.716702 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-61992820-eb24-47cf-a346-d4ffb00db2f0 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:06.721959 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-61992820-eb24-47cf-a346-d4ffb00db2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:06.752543 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75a5a43-e9c9-4869-b7dd-12126cdd4388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:06.754853 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a5a43-e9c9-4869-b7dd-12126cdd4388 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:06.755144 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a5a43-e9c9-4869-b7dd-12126cdd4388 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:06.755430 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a5a43-e9c9-4869-b7dd-12126cdd4388 None admin] PATH_INFO: `/v3/users/b0caf686ab3b4cbf8b38e1d67924962f` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:06.756734 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75a5a43-e9c9-4869-b7dd-12126cdd4388 None admin] RBAC: Authorizing `identity:get_user(user_id=b0caf686ab3b4cbf8b38e1d67924962f)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:06.758267 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75a5a43-e9c9-4869-b7dd-12126cdd4388 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:06.760264 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 127/252] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jul 15 20:37:06 2022] GET /identity/v3/users/b0caf686ab3b4cbf8b38e1d67924962f => generated 297 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:06.761543 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa2848-6441-49ec-93e9-76255b57b200 None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:06.761831 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa2848-6441-49ec-93e9-76255b57b200 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:06.762143 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa2848-6441-49ec-93e9-76255b57b200 None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:06.763596 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 128/253] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:37:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:37:06.769226 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfa2848-6441-49ec-93e9-76255b57b200 None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:06.849427 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 126/254] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:37:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:37:06.851084 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df64874-7e5c-45a8-904c-86c74e081afc None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:06.851579 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df64874-7e5c-45a8-904c-86c74e081afc None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:06.852109 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df64874-7e5c-45a8-904c-86c74e081afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:06.886367 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-0df64874-7e5c-45a8-904c-86c74e081afc None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:06.888022 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-0df64874-7e5c-45a8-904c-86c74e081afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:06.890793 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:06.901673 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfa2848-6441-49ec-93e9-76255b57b200 None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:06.955564 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993fc7a6-1c96-40f7-9b1f-2ff92f11c641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:06.956451 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993fc7a6-1c96-40f7-9b1f-2ff92f11c641 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:06.956795 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993fc7a6-1c96-40f7-9b1f-2ff92f11c641 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:06.957073 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993fc7a6-1c96-40f7-9b1f-2ff92f11c641 None admin] PATH_INFO: `/v3/projects/05cc472462c7477e9894e8c7c170ce4b` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:06.958306 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993fc7a6-1c96-40f7-9b1f-2ff92f11c641 None admin] RBAC: Authorizing `identity:get_project(project_id=05cc472462c7477e9894e8c7c170ce4b)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:06.960373 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993fc7a6-1c96-40f7-9b1f-2ff92f11c641 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:06.962318 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 129/255] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jul 15 20:37:06 2022] GET /identity/v3/projects/05cc472462c7477e9894e8c7c170ce4b => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:06.963649 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993fc7a6-1c96-40f7-9b1f-2ff92f11c641 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:07.025705 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:07.040102 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 127/256] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:37:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:37:07.046285 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df64874-7e5c-45a8-904c-86c74e081afc None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:07.112798 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993fc7a6-1c96-40f7-9b1f-2ff92f11c641 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:07.152927 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840540ea-f2ba-4b86-90fc-1bb5eed051b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:07.153727 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840540ea-f2ba-4b86-90fc-1bb5eed051b5 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:07.154010 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840540ea-f2ba-4b86-90fc-1bb5eed051b5 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:07.154314 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840540ea-f2ba-4b86-90fc-1bb5eed051b5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:07.172276 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840540ea-f2ba-4b86-90fc-1bb5eed051b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:37:07.181416 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-840540ea-f2ba-4b86-90fc-1bb5eed051b5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:37:07.181416 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:07.181416 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:07.181416 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:07.181416 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:07.181416 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:07.181416 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:07.181416 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:07.181416 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:07.181416 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:07.181416 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:07.181416 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:07.181416 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:37:07.181416 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:37:07.181416 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:37:07.181416 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:37:07.182317 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:37:07.182317 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:37:07.182317 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:37:07.182317 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:37:07.182317 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:07.182317 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:07.182317 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:07.182317 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:07.182317 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:07.182317 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:07.182317 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:07.182317 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:07.182317 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:07.182317 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:07.182317 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:07.182317 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:07.189815 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:07.189815 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:07.189815 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:07.189815 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:07.189815 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:37:07.189815 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:37:07.189815 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:37:07.189815 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:37:07.189815 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:37:07.189815 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:37:07.189815 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:37:07.189815 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:37:07.189815 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 130/257] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Jul 15 20:37:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:37:07.189815 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840540ea-f2ba-4b86-90fc-1bb5eed051b5 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:07.226121 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:07.237847 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df64874-7e5c-45a8-904c-86c74e081afc None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:07.292324 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840540ea-f2ba-4b86-90fc-1bb5eed051b5 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:07.309792 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dbad77-9ce9-4a13-809b-2d43ea9776c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:07.310915 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dbad77-9ce9-4a13-809b-2d43ea9776c8 None admin] REQUEST_METHOD: `PUT` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:07.311310 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dbad77-9ce9-4a13-809b-2d43ea9776c8 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:07.311636 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dbad77-9ce9-4a13-809b-2d43ea9776c8 None admin] PATH_INFO: `/v3/projects/05cc472462c7477e9894e8c7c170ce4b/users/b0caf686ab3b4cbf8b38e1d67924962f/roles/478906d6337444e68ea74da908d9a24d` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:07.319006 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dbad77-9ce9-4a13-809b-2d43ea9776c8 None admin] RBAC: Authorizing `identity:create_grant(project_id=05cc472462c7477e9894e8c7c170ce4b, user_id=b0caf686ab3b4cbf8b38e1d67924962f, role_id=478906d6337444e68ea74da908d9a24d)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:07.320794 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dbad77-9ce9-4a13-809b-2d43ea9776c8 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:07.331165 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2ff45a-e63d-459f-8642-584c6fa1cb09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:07.331980 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ff45a-e63d-459f-8642-584c6fa1cb09 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:07.332265 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ff45a-e63d-459f-8642-584c6fa1cb09 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:07.332543 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ff45a-e63d-459f-8642-584c6fa1cb09 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:07.344443 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2ff45a-e63d-459f-8642-584c6fa1cb09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:37:07.347795 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 128/258] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Jul 15 20:37:07 2022] PUT /identity/v3/projects/05cc472462c7477e9894e8c7c170ce4b/users/b0caf686ab3b4cbf8b38e1d67924962f/roles/478906d6337444e68ea74da908d9a24d => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:37:07.348668 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dbad77-9ce9-4a13-809b-2d43ea9776c8 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:07.352700 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-6f2ff45a-e63d-459f-8642-584c6fa1cb09 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 20:37:07.352700 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:07.352700 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:07.352700 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:07.352700 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:07.352700 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:07.352700 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:07.352700 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:07.352700 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:07.352700 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:07.352700 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:07.352700 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:07.352700 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:37:07.352700 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:37:07.352700 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:37:07.352700 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:37:07.353599 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:37:07.353599 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:37:07.353599 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:37:07.353599 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:37:07.353599 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:07.353599 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:07.353599 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:07.353599 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:07.353599 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:07.353599 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:07.353599 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:07.353599 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:07.353599 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:07.353599 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:07.353599 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:07.353599 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:07.354870 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:07.354870 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:07.354870 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:07.354870 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:07.354870 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:37:07.354870 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:37:07.354870 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:37:07.354870 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:37:07.354870 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:37:07.354870 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:37:07.354870 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 20:37:07.354870 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:37:07.354870 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 131/259] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Jul 15 20:37:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:37:07.360683 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2ff45a-e63d-459f-8642-584c6fa1cb09 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:07.450099 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:07.458291 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:07.471432 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2ff45a-e63d-459f-8642-584c6fa1cb09 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:07.509955 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2d99e7-abb1-4b56-a585-000a0b6ad240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:07.510768 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d99e7-abb1-4b56-a585-000a0b6ad240 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:07.511059 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d99e7-abb1-4b56-a585-000a0b6ad240 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:07.511340 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d99e7-abb1-4b56-a585-000a0b6ad240 None admin] PATH_INFO: `/v3/roles` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:07.512106 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2d99e7-abb1-4b56-a585-000a0b6ad240 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:07.512414 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2d99e7-abb1-4b56-a585-000a0b6ad240 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:07.518104 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2d99e7-abb1-4b56-a585-000a0b6ad240 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:07.523462 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 132/260] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jul 15 20:37:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:07.528968 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2d99e7-abb1-4b56-a585-000a0b6ad240 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:07.533711 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dbad77-9ce9-4a13-809b-2d43ea9776c8 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:07.575354 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d818b62c-5f4c-4e2e-995d-246408444fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:07.576501 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d818b62c-5f4c-4e2e-995d-246408444fa2 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:07.577012 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d818b62c-5f4c-4e2e-995d-246408444fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:07.577495 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d818b62c-5f4c-4e2e-995d-246408444fa2 None admin] PATH_INFO: `/v3/roles` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:07.578529 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d818b62c-5f4c-4e2e-995d-246408444fa2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:07.579168 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d818b62c-5f4c-4e2e-995d-246408444fa2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:07.580787 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d818b62c-5f4c-4e2e-995d-246408444fa2 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:07.591139 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 129/261] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jul 15 20:37:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:07.598222 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d818b62c-5f4c-4e2e-995d-246408444fa2 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:07.756354 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d818b62c-5f4c-4e2e-995d-246408444fa2 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:07.771897 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:07.789947 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2d99e7-abb1-4b56-a585-000a0b6ad240 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:07.797833 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd2780-9e9b-4b83-a08b-7a0caa0581f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:07.799063 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd2780-9e9b-4b83-a08b-7a0caa0581f9 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:07.799556 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd2780-9e9b-4b83-a08b-7a0caa0581f9 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:07.800032 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd2780-9e9b-4b83-a08b-7a0caa0581f9 None admin] PATH_INFO: `/v3/users/240ef4c3a71c4a96adfacb933f4793ec` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:07.801555 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cd2780-9e9b-4b83-a08b-7a0caa0581f9 None admin] RBAC: Authorizing `identity:get_user(user_id=240ef4c3a71c4a96adfacb933f4793ec)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:07.803242 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cd2780-9e9b-4b83-a08b-7a0caa0581f9 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:07.805511 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 130/262] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jul 15 20:37:07 2022] GET /identity/v3/users/240ef4c3a71c4a96adfacb933f4793ec => generated 283 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:37:07.811628 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd2780-9e9b-4b83-a08b-7a0caa0581f9 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:07.887451 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd7e7ae-a831-4493-bb19-d486e48b7114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:07.888264 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7e7ae-a831-4493-bb19-d486e48b7114 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:07.888551 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7e7ae-a831-4493-bb19-d486e48b7114 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:07.888828 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7e7ae-a831-4493-bb19-d486e48b7114 None admin] PATH_INFO: `/v3/users/240ef4c3a71c4a96adfacb933f4793ec` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:07.893122 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd7e7ae-a831-4493-bb19-d486e48b7114 None admin] RBAC: Authorizing `identity:get_user(user_id=240ef4c3a71c4a96adfacb933f4793ec)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:07.894614 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd7e7ae-a831-4493-bb19-d486e48b7114 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:07.896673 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 133/263] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jul 15 20:37:07 2022] GET /identity/v3/users/240ef4c3a71c4a96adfacb933f4793ec => generated 283 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:07.907360 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd7e7ae-a831-4493-bb19-d486e48b7114 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:07.960596 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd2780-9e9b-4b83-a08b-7a0caa0581f9 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:07.967502 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:08.009833 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bf3b35-b261-40db-81cb-3b3c3ddf9331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:08.010900 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf3b35-b261-40db-81cb-3b3c3ddf9331 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:08.011327 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf3b35-b261-40db-81cb-3b3c3ddf9331 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:08.011772 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf3b35-b261-40db-81cb-3b3c3ddf9331 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:08.126526 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:08.163153 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bf3b35-b261-40db-81cb-3b3c3ddf9331 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:08.164829 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bf3b35-b261-40db-81cb-3b3c3ddf9331 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:08.198136 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd7e7ae-a831-4493-bb19-d486e48b7114 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:08.237350 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d63457-d130-49c2-9e5e-d5d2da26d9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:08.238380 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d63457-d130-49c2-9e5e-d5d2da26d9f1 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:08.238872 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d63457-d130-49c2-9e5e-d5d2da26d9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:08.239349 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d63457-d130-49c2-9e5e-d5d2da26d9f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:08.318425 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d63457-d130-49c2-9e5e-d5d2da26d9f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:08.320804 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d63457-d130-49c2-9e5e-d5d2da26d9f1 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:08.347313 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:08.395664 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 131/264] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jul 15 20:37:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 584 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 15 20:37:08.400984 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bf3b35-b261-40db-81cb-3b3c3ddf9331 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:08.441380 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 134/265] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jul 15 20:37:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:08.447582 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d63457-d130-49c2-9e5e-d5d2da26d9f1 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:08.563891 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d63457-d130-49c2-9e5e-d5d2da26d9f1 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:08.584190 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:08.608092 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec38cb3-00a3-4022-ad5e-132cb53b4eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:08.608092 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec38cb3-00a3-4022-ad5e-132cb53b4eab None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:08.608092 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec38cb3-00a3-4022-ad5e-132cb53b4eab None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:08.608092 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec38cb3-00a3-4022-ad5e-132cb53b4eab None admin] PATH_INFO: `/v3/projects/05cc472462c7477e9894e8c7c170ce4b` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:08.608522 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec38cb3-00a3-4022-ad5e-132cb53b4eab None admin] RBAC: Authorizing `identity:get_project(project_id=05cc472462c7477e9894e8c7c170ce4b)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:08.609318 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec38cb3-00a3-4022-ad5e-132cb53b4eab None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:08.612347 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 135/266] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jul 15 20:37:08 2022] GET /identity/v3/projects/05cc472462c7477e9894e8c7c170ce4b => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:08.619005 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec38cb3-00a3-4022-ad5e-132cb53b4eab None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:08.646429 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:08.675527 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bf3b35-b261-40db-81cb-3b3c3ddf9331 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:08.736977 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec38cb3-00a3-4022-ad5e-132cb53b4eab None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:08.748114 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d6711a-5bda-4ac6-8331-afbeecf85cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:08.749291 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d6711a-5bda-4ac6-8331-afbeecf85cbe None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:08.750374 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d6711a-5bda-4ac6-8331-afbeecf85cbe None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:08.750852 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d6711a-5bda-4ac6-8331-afbeecf85cbe None admin] PATH_INFO: `/v3/projects/05cc472462c7477e9894e8c7c170ce4b` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:08.754782 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d6711a-5bda-4ac6-8331-afbeecf85cbe None admin] RBAC: Authorizing `identity:get_project(project_id=05cc472462c7477e9894e8c7c170ce4b)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:08.756460 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d6711a-5bda-4ac6-8331-afbeecf85cbe None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:08.758404 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 132/267] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jul 15 20:37:08 2022] GET /identity/v3/projects/05cc472462c7477e9894e8c7c170ce4b => generated 302 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:37:08.764206 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d6711a-5bda-4ac6-8331-afbeecf85cbe None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:08.774575 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc1ac8d-346f-4894-b03e-87f52bd43ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:08.775269 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc1ac8d-346f-4894-b03e-87f52bd43ad7 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:08.775564 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc1ac8d-346f-4894-b03e-87f52bd43ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:08.775844 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc1ac8d-346f-4894-b03e-87f52bd43ad7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:08.777512 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc1ac8d-346f-4894-b03e-87f52bd43ad7 None admin] RBAC: Adding query filter params (role.id=7deae0ce5d074f488024c63c8ce63928, scope.project.id=05cc472462c7477e9894e8c7c170ce4b, user.id=240ef4c3a71c4a96adfacb933f4793ec) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:08.777841 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc1ac8d-346f-4894-b03e-87f52bd43ad7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:08.779345 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc1ac8d-346f-4894-b03e-87f52bd43ad7 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:08.785954 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 136/268] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jul 15 20:37:08 2022] GET /identity/v3/role_assignments?user.id=240ef4c3a71c4a96adfacb933f4793ec&scope.project.id=05cc472462c7477e9894e8c7c170ce4b&role.id=7deae0ce5d074f488024c63c8ce63928 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:08.942674 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d6711a-5bda-4ac6-8331-afbeecf85cbe None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:08.996544 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c74e76-68cc-4ea1-9eef-308415e2b2e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:08.997550 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c74e76-68cc-4ea1-9eef-308415e2b2e1 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:08.998036 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c74e76-68cc-4ea1-9eef-308415e2b2e1 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:08.998530 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c74e76-68cc-4ea1-9eef-308415e2b2e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:08.999631 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c74e76-68cc-4ea1-9eef-308415e2b2e1 None admin] RBAC: Adding query filter params (role.id=cbcae224848142ce888ca5b84abfd18e, scope.project.id=05cc472462c7477e9894e8c7c170ce4b, user.id=240ef4c3a71c4a96adfacb933f4793ec) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:09.000653 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c74e76-68cc-4ea1-9eef-308415e2b2e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:09.002318 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c74e76-68cc-4ea1-9eef-308415e2b2e1 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:09.010028 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 133/269] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jul 15 20:37:08 2022] GET /identity/v3/role_assignments?user.id=240ef4c3a71c4a96adfacb933f4793ec&scope.project.id=05cc472462c7477e9894e8c7c170ce4b&role.id=cbcae224848142ce888ca5b84abfd18e => generated 608 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:09.293379 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d25a66-7655-45dc-8b9a-ff07d9824b2a None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:09.293886 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d25a66-7655-45dc-8b9a-ff07d9824b2a None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:09.293886 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d25a66-7655-45dc-8b9a-ff07d9824b2a None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:09.295613 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 137/270] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:37:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:37:09.306722 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b23d17e-e6a0-4ed5-b46c-04902fcf2ec3 None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:09.307210 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b23d17e-e6a0-4ed5-b46c-04902fcf2ec3 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:09.307310 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b23d17e-e6a0-4ed5-b46c-04902fcf2ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:09.327322 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-7b23d17e-e6a0-4ed5-b46c-04902fcf2ec3 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:09.328601 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-7b23d17e-e6a0-4ed5-b46c-04902fcf2ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:09.341745 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:09.421801 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 134/271] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:37:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:37:09.452499 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d25a66-7655-45dc-8b9a-ff07d9824b2a None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:09.512963 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:09.565387 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d25a66-7655-45dc-8b9a-ff07d9824b2a None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:09.600623 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3483f487-3e70-4dec-b3f3-f1afbe9a45e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:09.601432 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483f487-3e70-4dec-b3f3-f1afbe9a45e3 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:09.601720 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483f487-3e70-4dec-b3f3-f1afbe9a45e3 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:09.602058 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483f487-3e70-4dec-b3f3-f1afbe9a45e3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:09.613513 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3483f487-3e70-4dec-b3f3-f1afbe9a45e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:37:09.621405 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-3483f487-3e70-4dec-b3f3-f1afbe9a45e3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 20:37:09.621405 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:09.621405 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:09.621405 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:09.621405 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:09.621405 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:09.621405 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:09.621405 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:09.621405 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:09.621405 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:09.621405 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:09.621405 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:09.621405 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:37:09.621405 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:37:09.621405 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:37:09.621405 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:37:09.622353 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:37:09.622353 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:37:09.622353 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:37:09.622353 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:37:09.622353 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:09.622353 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:09.622353 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:09.622353 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:09.622353 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:09.622353 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:09.622353 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:09.622353 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:09.622353 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:09.622353 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:09.622353 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:09.622353 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:09.623114 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:09.623114 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:09.623114 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:09.623114 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:09.623114 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:37:09.623114 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:37:09.623114 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:37:09.623114 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:37:09.623114 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:37:09.623114 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:37:09.623114 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 20:37:09.623114 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:37:09.623114 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 138/272] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jul 15 20:37:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:37:09.629382 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b23d17e-e6a0-4ed5-b46c-04902fcf2ec3 None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:09.738381 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b23d17e-e6a0-4ed5-b46c-04902fcf2ec3 None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:09.778840 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e806ae-48b0-4e37-b5eb-0a49e9e28a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:09.779607 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e806ae-48b0-4e37-b5eb-0a49e9e28a9a None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:09.779965 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e806ae-48b0-4e37-b5eb-0a49e9e28a9a None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:09.780315 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e806ae-48b0-4e37-b5eb-0a49e9e28a9a None admin] PATH_INFO: `/v3/roles` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:09.781706 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e806ae-48b0-4e37-b5eb-0a49e9e28a9a None admin] RBAC: Adding query filter params (name=member) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:09.782098 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e806ae-48b0-4e37-b5eb-0a49e9e28a9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:09.783549 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e806ae-48b0-4e37-b5eb-0a49e9e28a9a None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:09.792549 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 135/273] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Jul 15 20:37:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:09.793978 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdc8266-6afd-45dc-ae30-16346cba2dab None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:09.795337 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdc8266-6afd-45dc-ae30-16346cba2dab None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:09.795817 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdc8266-6afd-45dc-ae30-16346cba2dab None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:09.797398 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 139/274] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:37:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:37:09.803424 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a0a5ea-3f37-4794-9cea-1d61d9bbe42f None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:09.803743 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a0a5ea-3f37-4794-9cea-1d61d9bbe42f None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:09.803988 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a0a5ea-3f37-4794-9cea-1d61d9bbe42f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:09.806191 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e806ae-48b0-4e37-b5eb-0a49e9e28a9a None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:09.815525 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:09.826832 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-15a0a5ea-3f37-4794-9cea-1d61d9bbe42f None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:09.829318 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-15a0a5ea-3f37-4794-9cea-1d61d9bbe42f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:09.914035 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 140/275] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:37:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 20:37:09.915377 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2052887-7e00-4c3a-bb0d-6fcc04d74176 None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:09.915668 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2052887-7e00-4c3a-bb0d-6fcc04d74176 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:09.915947 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2052887-7e00-4c3a-bb0d-6fcc04d74176 None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:09.917352 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 141/276] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:37:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:37:09.922512 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9326b073-7561-4dd7-85d4-ec40f76997df None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:09.922862 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9326b073-7561-4dd7-85d4-ec40f76997df None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:09.923079 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9326b073-7561-4dd7-85d4-ec40f76997df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:09.924693 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e806ae-48b0-4e37-b5eb-0a49e9e28a9a None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:09.939767 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-9326b073-7561-4dd7-85d4-ec40f76997df None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:09.940671 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-9326b073-7561-4dd7-85d4-ec40f76997df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:09.964019 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85965803-00b2-45b6-90bb-042839b69c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:09.965388 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85965803-00b2-45b6-90bb-042839b69c9e None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:09.965875 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85965803-00b2-45b6-90bb-042839b69c9e None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:09.966376 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85965803-00b2-45b6-90bb-042839b69c9e None admin] PATH_INFO: `/v3/users/9f0806cb23b6434da3f56b77e95860cf` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:09.976025 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:09.982096 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85965803-00b2-45b6-90bb-042839b69c9e None admin] RBAC: Authorizing `identity:get_user(user_id=9f0806cb23b6434da3f56b77e95860cf)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:09.983568 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85965803-00b2-45b6-90bb-042839b69c9e None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:09.989885 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 136/277] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jul 15 20:37:09 2022] GET /identity/v3/users/9f0806cb23b6434da3f56b77e95860cf => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:09.989885 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85965803-00b2-45b6-90bb-042839b69c9e None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:10.015126 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 142/278] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:37:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:37:10.026997 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9326b073-7561-4dd7-85d4-ec40f76997df None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:10.054802 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:10.095430 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85965803-00b2-45b6-90bb-042839b69c9e None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:10.132675 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3935c2db-b839-4006-906c-0491c430019d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:10.133471 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3935c2db-b839-4006-906c-0491c430019d None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:10.133762 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3935c2db-b839-4006-906c-0491c430019d None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:10.134044 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3935c2db-b839-4006-906c-0491c430019d None admin] PATH_INFO: `/v3/domains/default` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:10.135128 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9326b073-7561-4dd7-85d4-ec40f76997df None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:10.135234 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3935c2db-b839-4006-906c-0491c430019d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:10.136812 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3935c2db-b839-4006-906c-0491c430019d None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:10.144961 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 137/279] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jul 15 20:37:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:10.144961 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3935c2db-b839-4006-906c-0491c430019d None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:10.174436 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03104994-7275-40c6-b29b-e3451db3ed1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:10.175094 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03104994-7275-40c6-b29b-e3451db3ed1d None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:10.175384 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03104994-7275-40c6-b29b-e3451db3ed1d None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:10.175660 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03104994-7275-40c6-b29b-e3451db3ed1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:10.176476 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03104994-7275-40c6-b29b-e3451db3ed1d None admin] RBAC: Adding query filter params (role.id=478906d6337444e68ea74da908d9a24d, user.id=9f0806cb23b6434da3f56b77e95860cf, scope.system=all) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:10.176796 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03104994-7275-40c6-b29b-e3451db3ed1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:10.178258 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03104994-7275-40c6-b29b-e3451db3ed1d None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:10.183100 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 143/280] 10.222.0.16 () {56 vars in 1308 bytes} [Fri Jul 15 20:37:10 2022] GET /identity/v3/role_assignments?user.id=9f0806cb23b6434da3f56b77e95860cf&scope.system=all&role.id=478906d6337444e68ea74da908d9a24d => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:10.183100 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03104994-7275-40c6-b29b-e3451db3ed1d None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:10.230760 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:10.282304 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3935c2db-b839-4006-906c-0491c430019d None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:10.327190 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03104994-7275-40c6-b29b-e3451db3ed1d None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:10.328526 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:10.341437 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286487bd-d742-4d84-8f3a-9d5e3564f572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:10.342436 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286487bd-d742-4d84-8f3a-9d5e3564f572 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:10.342809 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286487bd-d742-4d84-8f3a-9d5e3564f572 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:10.343912 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286487bd-d742-4d84-8f3a-9d5e3564f572 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:10.362806 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286487bd-d742-4d84-8f3a-9d5e3564f572 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:37:10.374608 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-286487bd-d742-4d84-8f3a-9d5e3564f572 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 20:37:10.374608 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:10.374608 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:10.374608 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:10.374608 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:10.374608 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:10.374608 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:10.374608 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:10.374608 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:10.374608 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:10.374608 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:10.374608 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:10.374608 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:37:10.374608 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:37:10.374608 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:37:10.374608 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:37:10.376130 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:37:10.376130 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:37:10.376130 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:37:10.376130 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:37:10.376130 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:10.376130 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:10.376130 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:10.376130 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:10.376130 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:10.376130 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:10.376130 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:10.376130 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:10.376130 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:10.376130 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:10.376130 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:10.376130 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:10.377083 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:10.377083 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:10.377083 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:10.377083 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:10.377083 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:37:10.377083 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:37:10.377083 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:37:10.377083 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:37:10.377083 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:37:10.377083 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:37:10.377083 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 20:37:10.377083 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:37:10.378778 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 138/281] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jul 15 20:37:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:37:10.384125 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb1f2f6-7f4f-4fa1-8082-02882ec9a1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:10.385049 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1f2f6-7f4f-4fa1-8082-02882ec9a1d5 None admin] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:10.385174 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286487bd-d742-4d84-8f3a-9d5e3564f572 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:10.385712 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1f2f6-7f4f-4fa1-8082-02882ec9a1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:10.386255 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1f2f6-7f4f-4fa1-8082-02882ec9a1d5 None admin] PATH_INFO: `/v3/users` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:10.387214 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb1f2f6-7f4f-4fa1-8082-02882ec9a1d5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:10.389367 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb1f2f6-7f4f-4fa1-8082-02882ec9a1d5 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:10.419219 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 144/282] 10.222.0.16 () {60 vars in 1132 bytes} [Fri Jul 15 20:37:10 2022] POST /identity/v3/users => generated 293 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:37:10.515253 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286487bd-d742-4d84-8f3a-9d5e3564f572 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:10.520390 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82532ee-38b5-4b1f-a380-8f842965e811 None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:10.520684 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82532ee-38b5-4b1f-a380-8f842965e811 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:10.520970 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82532ee-38b5-4b1f-a380-8f842965e811 None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:10.523806 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 145/283] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:37:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 20:37:10.528388 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b537ac7e-53e0-413f-b486-d293ffc3ffce None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:10.528678 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b537ac7e-53e0-413f-b486-d293ffc3ffce None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:10.529002 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b537ac7e-53e0-413f-b486-d293ffc3ffce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:10.548451 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-b537ac7e-53e0-413f-b486-d293ffc3ffce None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:10.549674 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-b537ac7e-53e0-413f-b486-d293ffc3ffce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:10.568931 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a477d7d-4c42-4600-a14f-75309dc48c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:10.570324 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a477d7d-4c42-4600-a14f-75309dc48c7a None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:10.571106 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a477d7d-4c42-4600-a14f-75309dc48c7a None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:10.571568 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a477d7d-4c42-4600-a14f-75309dc48c7a None admin] PATH_INFO: `/v3/roles` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:10.572491 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a477d7d-4c42-4600-a14f-75309dc48c7a None admin] RBAC: Adding query filter params (name=reader) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:10.572951 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a477d7d-4c42-4600-a14f-75309dc48c7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:10.575137 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a477d7d-4c42-4600-a14f-75309dc48c7a None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:10.586587 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 139/284] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Jul 15 20:37:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:10.592852 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a477d7d-4c42-4600-a14f-75309dc48c7a None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:10.638000 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 146/285] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:37:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 20:37:10.661373 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b537ac7e-53e0-413f-b486-d293ffc3ffce None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:10.662843 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:10.685754 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:10.723279 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a477d7d-4c42-4600-a14f-75309dc48c7a None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:10.771958 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393dd334-59d2-47f7-bd4f-9b05c873f1ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:10.773446 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393dd334-59d2-47f7-bd4f-9b05c873f1ad None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:10.773913 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393dd334-59d2-47f7-bd4f-9b05c873f1ad None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:10.774392 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393dd334-59d2-47f7-bd4f-9b05c873f1ad None admin] PATH_INFO: `/v3/users/f1410e6bede9401388b7eb6e39d41e2f` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:10.775782 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393dd334-59d2-47f7-bd4f-9b05c873f1ad None admin] RBAC: Authorizing `identity:get_user(user_id=f1410e6bede9401388b7eb6e39d41e2f)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:10.777898 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393dd334-59d2-47f7-bd4f-9b05c873f1ad None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:10.779964 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 140/286] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jul 15 20:37:10 2022] GET /identity/v3/users/f1410e6bede9401388b7eb6e39d41e2f => generated 297 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:37:10.786712 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393dd334-59d2-47f7-bd4f-9b05c873f1ad None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:10.791739 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b537ac7e-53e0-413f-b486-d293ffc3ffce None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:10.845822 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684ed105-d21d-47bc-85bd-32e6e3cfa98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:10.846706 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ed105-d21d-47bc-85bd-32e6e3cfa98a None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:10.847251 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ed105-d21d-47bc-85bd-32e6e3cfa98a None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:10.847690 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ed105-d21d-47bc-85bd-32e6e3cfa98a None admin] PATH_INFO: `/v3/roles/member` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:10.859232 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684ed105-d21d-47bc-85bd-32e6e3cfa98a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:37:10.868985 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-684ed105-d21d-47bc-85bd-32e6e3cfa98a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 20:37:10.868985 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:10.868985 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:10.868985 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:10.868985 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:10.868985 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:10.868985 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:10.868985 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:10.868985 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:10.868985 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:10.868985 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:10.868985 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:10.868985 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:37:10.868985 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:37:10.868985 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:37:10.868985 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:37:10.870062 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:37:10.870062 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:37:10.870062 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:37:10.870062 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:37:10.870062 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:10.870062 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:10.870062 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:10.870062 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:10.870062 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:10.870062 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:10.870062 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:10.870062 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:10.870062 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:10.870062 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:10.870062 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:10.870062 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:10.870977 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:10.870977 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:10.870977 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:10.870977 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:10.870977 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:37:10.870977 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:37:10.870977 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:37:10.870977 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:37:10.870977 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:37:10.870977 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:37:10.870977 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 20:37:10.870977 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:37:10.870977 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 147/287] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jul 15 20:37:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 20:37:10.875919 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684ed105-d21d-47bc-85bd-32e6e3cfa98a None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:10.901025 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393dd334-59d2-47f7-bd4f-9b05c873f1ad None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:10.935206 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:10.940967 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562ed9e9-05fc-4381-ae95-640229bb93c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:10.941962 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ed9e9-05fc-4381-ae95-640229bb93c6 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:10.942474 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ed9e9-05fc-4381-ae95-640229bb93c6 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:10.942859 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ed9e9-05fc-4381-ae95-640229bb93c6 None admin] PATH_INFO: `/v3/projects/05cc472462c7477e9894e8c7c170ce4b` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:10.944192 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562ed9e9-05fc-4381-ae95-640229bb93c6 None admin] RBAC: Authorizing `identity:get_project(project_id=05cc472462c7477e9894e8c7c170ce4b)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:10.946288 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562ed9e9-05fc-4381-ae95-640229bb93c6 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:10.953040 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 141/288] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jul 15 20:37:10 2022] GET /identity/v3/projects/05cc472462c7477e9894e8c7c170ce4b => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:37:10.954340 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562ed9e9-05fc-4381-ae95-640229bb93c6 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:10.974294 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:10.995028 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684ed105-d21d-47bc-85bd-32e6e3cfa98a None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:11.029205 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac8c1ef-0f81-426f-a846-5fc2f96a498a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:11.029876 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac8c1ef-0f81-426f-a846-5fc2f96a498a None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:11.030208 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac8c1ef-0f81-426f-a846-5fc2f96a498a None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:11.030482 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac8c1ef-0f81-426f-a846-5fc2f96a498a None admin] PATH_INFO: `/v3/roles` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:11.038415 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac8c1ef-0f81-426f-a846-5fc2f96a498a None admin] RBAC: Adding query filter params (name=member) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:11.038875 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac8c1ef-0f81-426f-a846-5fc2f96a498a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:11.040322 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac8c1ef-0f81-426f-a846-5fc2f96a498a None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:11.057775 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 148/289] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Jul 15 20:37:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:37:11.063676 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac8c1ef-0f81-426f-a846-5fc2f96a498a None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:11.066117 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562ed9e9-05fc-4381-ae95-640229bb93c6 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:11.103770 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be26014c-e0c0-4735-911d-06da7093e524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:11.104816 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be26014c-e0c0-4735-911d-06da7093e524 None admin] REQUEST_METHOD: `PUT` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:11.105215 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be26014c-e0c0-4735-911d-06da7093e524 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:11.105838 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be26014c-e0c0-4735-911d-06da7093e524 None admin] PATH_INFO: `/v3/projects/05cc472462c7477e9894e8c7c170ce4b/users/f1410e6bede9401388b7eb6e39d41e2f/roles/e2a7ac9ae1fe4d4b988ae2dc2c8ab021` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:11.108033 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be26014c-e0c0-4735-911d-06da7093e524 None admin] RBAC: Authorizing `identity:create_grant(project_id=05cc472462c7477e9894e8c7c170ce4b, user_id=f1410e6bede9401388b7eb6e39d41e2f, role_id=e2a7ac9ae1fe4d4b988ae2dc2c8ab021)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:11.110693 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be26014c-e0c0-4735-911d-06da7093e524 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:11.132403 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 142/290] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Jul 15 20:37:10 2022] PUT /identity/v3/projects/05cc472462c7477e9894e8c7c170ce4b/users/f1410e6bede9401388b7eb6e39d41e2f/roles/e2a7ac9ae1fe4d4b988ae2dc2c8ab021 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 20:37:11.254924 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac8c1ef-0f81-426f-a846-5fc2f96a498a None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:11.300425 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027df57c-acb2-427f-8b54-84b90838c951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:11.301335 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027df57c-acb2-427f-8b54-84b90838c951 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:11.301621 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027df57c-acb2-427f-8b54-84b90838c951 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:11.301898 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027df57c-acb2-427f-8b54-84b90838c951 None admin] PATH_INFO: `/v3/users/b0caf686ab3b4cbf8b38e1d67924962f` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:11.306963 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027df57c-acb2-427f-8b54-84b90838c951 None admin] RBAC: Authorizing `identity:get_user(user_id=b0caf686ab3b4cbf8b38e1d67924962f)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:11.308532 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027df57c-acb2-427f-8b54-84b90838c951 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:11.310697 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 149/291] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jul 15 20:37:11 2022] GET /identity/v3/users/b0caf686ab3b4cbf8b38e1d67924962f => generated 297 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:37:11.316268 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be26014c-e0c0-4735-911d-06da7093e524 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:11.394695 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:11.460201 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be26014c-e0c0-4735-911d-06da7093e524 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:11.516388 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b075ff9-0f5d-4138-9def-b335857dd7c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:11.516968 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b075ff9-0f5d-4138-9def-b335857dd7c7 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:11.517248 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b075ff9-0f5d-4138-9def-b335857dd7c7 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:11.517524 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b075ff9-0f5d-4138-9def-b335857dd7c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:11.611973 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b075ff9-0f5d-4138-9def-b335857dd7c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:11.613444 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b075ff9-0f5d-4138-9def-b335857dd7c7 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:11.686435 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:11.755294 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 143/292] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jul 15 20:37:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:11.761180 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027df57c-acb2-427f-8b54-84b90838c951 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:11.786495 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:11.937781 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027df57c-acb2-427f-8b54-84b90838c951 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:11.977488 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c655a7f0-8423-4132-bdbf-c7c9e06fe589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:11.978382 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c655a7f0-8423-4132-bdbf-c7c9e06fe589 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:11.978672 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c655a7f0-8423-4132-bdbf-c7c9e06fe589 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:11.978949 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c655a7f0-8423-4132-bdbf-c7c9e06fe589 None admin] PATH_INFO: `/v3/projects/05cc472462c7477e9894e8c7c170ce4b` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:11.980153 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c655a7f0-8423-4132-bdbf-c7c9e06fe589 None admin] RBAC: Authorizing `identity:get_project(project_id=05cc472462c7477e9894e8c7c170ce4b)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:11.981615 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c655a7f0-8423-4132-bdbf-c7c9e06fe589 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:11.983478 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 150/293] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jul 15 20:37:11 2022] GET /identity/v3/projects/05cc472462c7477e9894e8c7c170ce4b => generated 302 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:11.991181 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b075ff9-0f5d-4138-9def-b335857dd7c7 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:12.146284 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b075ff9-0f5d-4138-9def-b335857dd7c7 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:12.197129 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d383e1-cdaa-4305-a5a6-adfcbba9b8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:12.197784 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d383e1-cdaa-4305-a5a6-adfcbba9b8b6 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:12.198096 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d383e1-cdaa-4305-a5a6-adfcbba9b8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:12.198367 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d383e1-cdaa-4305-a5a6-adfcbba9b8b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:12.199193 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d383e1-cdaa-4305-a5a6-adfcbba9b8b6 None admin] RBAC: Adding query filter params (role.id=478906d6337444e68ea74da908d9a24d, scope.project.id=05cc472462c7477e9894e8c7c170ce4b, user.id=b0caf686ab3b4cbf8b38e1d67924962f) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:12.199601 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d383e1-cdaa-4305-a5a6-adfcbba9b8b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:12.201040 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d383e1-cdaa-4305-a5a6-adfcbba9b8b6 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:12.207421 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 144/294] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jul 15 20:37:11 2022] GET /identity/v3/role_assignments?user.id=b0caf686ab3b4cbf8b38e1d67924962f&scope.project.id=05cc472462c7477e9894e8c7c170ce4b&role.id=478906d6337444e68ea74da908d9a24d => generated 608 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:12.792715 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804475cd-0743-40c6-90c9-db9ba500f94b None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:12.793211 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804475cd-0743-40c6-90c9-db9ba500f94b None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:12.793211 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804475cd-0743-40c6-90c9-db9ba500f94b None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:12.794859 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 151/295] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:37:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:37:12.800661 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d6a5b-6b6e-4704-89ac-f0ff74f420ca None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:12.801164 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d6a5b-6b6e-4704-89ac-f0ff74f420ca None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:12.801236 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d6a5b-6b6e-4704-89ac-f0ff74f420ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:12.823532 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-802d6a5b-6b6e-4704-89ac-f0ff74f420ca None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:12.824749 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-802d6a5b-6b6e-4704-89ac-f0ff74f420ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:12.845329 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:12.905532 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 145/296] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:37:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:37:12.929233 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804475cd-0743-40c6-90c9-db9ba500f94b None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:13.011446 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:13.035220 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804475cd-0743-40c6-90c9-db9ba500f94b None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:13.068709 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0420f1c6-ff91-4fc0-94b8-0e9f10fb29e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:13.069688 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0420f1c6-ff91-4fc0-94b8-0e9f10fb29e9 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:13.069975 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0420f1c6-ff91-4fc0-94b8-0e9f10fb29e9 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:13.070280 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0420f1c6-ff91-4fc0-94b8-0e9f10fb29e9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:13.081201 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0420f1c6-ff91-4fc0-94b8-0e9f10fb29e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:37:13.088976 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-0420f1c6-ff91-4fc0-94b8-0e9f10fb29e9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 20:37:13.088976 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:13.088976 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:13.088976 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:13.088976 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:13.088976 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:13.088976 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:13.088976 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:13.088976 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:13.088976 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:13.088976 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:13.088976 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:13.088976 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:37:13.088976 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:37:13.088976 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:37:13.088976 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:37:13.089837 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:37:13.089837 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:37:13.089837 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:37:13.089837 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:37:13.089837 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:13.089837 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:13.089837 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:13.089837 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:13.089837 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:13.089837 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:13.089837 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:13.089837 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:13.089837 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:13.089837 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:13.089837 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:13.089837 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:13.090664 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:13.090664 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:13.090664 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:13.090664 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:13.090664 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:37:13.090664 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:37:13.090664 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:37:13.090664 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:37:13.090664 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:37:13.090664 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:37:13.090664 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 20:37:13.090664 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:37:13.090664 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 152/297] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jul 15 20:37:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:37:13.096438 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d6a5b-6b6e-4704-89ac-f0ff74f420ca None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:13.207403 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d6a5b-6b6e-4704-89ac-f0ff74f420ca None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:13.247026 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ef014d-0344-4588-a653-48d280b787fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:13.247719 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ef014d-0344-4588-a653-48d280b787fb None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:13.248014 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ef014d-0344-4588-a653-48d280b787fb None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:13.248299 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ef014d-0344-4588-a653-48d280b787fb None admin] PATH_INFO: `/v3/roles` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:13.249071 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ef014d-0344-4588-a653-48d280b787fb None admin] RBAC: Adding query filter params (name=member) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:13.249385 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ef014d-0344-4588-a653-48d280b787fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:13.250885 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ef014d-0344-4588-a653-48d280b787fb None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:13.260331 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 146/298] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Jul 15 20:37:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:13.265851 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0420f1c6-ff91-4fc0-94b8-0e9f10fb29e9 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:13.301256 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec30e2-4f34-42f8-92f6-ae5174e4f508 None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:13.301717 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec30e2-4f34-42f8-92f6-ae5174e4f508 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:13.302006 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec30e2-4f34-42f8-92f6-ae5174e4f508 None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:13.304580 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 147/299] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:37:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 20:37:13.309745 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755482fb-8619-46b7-b384-06938bf32cc3 None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:13.310202 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755482fb-8619-46b7-b384-06938bf32cc3 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:13.310589 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755482fb-8619-46b7-b384-06938bf32cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:13.326123 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:13.333624 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-755482fb-8619-46b7-b384-06938bf32cc3 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:13.335462 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-755482fb-8619-46b7-b384-06938bf32cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:13.376418 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0420f1c6-ff91-4fc0-94b8-0e9f10fb29e9 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:13.415795 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dc52ef-5559-43e0-a647-acaed90d49d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:13.416795 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc52ef-5559-43e0-a647-acaed90d49d1 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:13.417080 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc52ef-5559-43e0-a647-acaed90d49d1 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:13.417353 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc52ef-5559-43e0-a647-acaed90d49d1 None admin] PATH_INFO: `/v3/users/9f0806cb23b6434da3f56b77e95860cf` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:13.418574 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dc52ef-5559-43e0-a647-acaed90d49d1 None admin] RBAC: Authorizing `identity:get_user(user_id=9f0806cb23b6434da3f56b77e95860cf)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:13.420008 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dc52ef-5559-43e0-a647-acaed90d49d1 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:13.422125 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 148/300] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:37:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 20:37:13.422261 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 153/301] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jul 15 20:37:13 2022] GET /identity/v3/users/9f0806cb23b6434da3f56b77e95860cf => generated 293 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:13.426541 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee5c28-500e-4a78-abd1-549230a3f2f4 None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:13.426840 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee5c28-500e-4a78-abd1-549230a3f2f4 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:13.427125 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee5c28-500e-4a78-abd1-549230a3f2f4 None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:13.427465 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dc52ef-5559-43e0-a647-acaed90d49d1 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:13.428847 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 149/302] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:37:13 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:37:13.435438 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bed90d0-548e-4eb1-8ef1-553509bf744a None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:13.435834 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bed90d0-548e-4eb1-8ef1-553509bf744a None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:13.436214 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bed90d0-548e-4eb1-8ef1-553509bf744a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:13.437530 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:13.458947 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-4bed90d0-548e-4eb1-8ef1-553509bf744a None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:13.460243 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-4bed90d0-548e-4eb1-8ef1-553509bf744a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:13.537648 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 150/303] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:37:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 20:37:13.539281 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bed90d0-548e-4eb1-8ef1-553509bf744a None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:13.547653 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dc52ef-5559-43e0-a647-acaed90d49d1 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:13.584216 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c2eb47-3ae3-45bb-b099-240885b68db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:13.585001 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c2eb47-3ae3-45bb-b099-240885b68db1 None admin] REQUEST_METHOD: `PUT` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:13.585290 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c2eb47-3ae3-45bb-b099-240885b68db1 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:13.585575 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c2eb47-3ae3-45bb-b099-240885b68db1 None admin] PATH_INFO: `/v3/system/users/9f0806cb23b6434da3f56b77e95860cf/roles/478906d6337444e68ea74da908d9a24d` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:13.587102 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c2eb47-3ae3-45bb-b099-240885b68db1 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=9f0806cb23b6434da3f56b77e95860cf, role_id=478906d6337444e68ea74da908d9a24d)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:13.588483 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c2eb47-3ae3-45bb-b099-240885b68db1 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:13.598675 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 154/304] 10.222.0.16 () {58 vars in 1334 bytes} [Fri Jul 15 20:37:13 2022] PUT /identity/v3/system/users/9f0806cb23b6434da3f56b77e95860cf/roles/478906d6337444e68ea74da908d9a24d => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 20:37:13.600105 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c2eb47-3ae3-45bb-b099-240885b68db1 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:13.615785 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:13.660104 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bed90d0-548e-4eb1-8ef1-553509bf744a None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:13.710873 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd56dba-3425-409f-8155-767675d5a31e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:13.711807 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd56dba-3425-409f-8155-767675d5a31e None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:13.712027 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:13.712171 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd56dba-3425-409f-8155-767675d5a31e None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:13.712559 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd56dba-3425-409f-8155-767675d5a31e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:13.733917 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd56dba-3425-409f-8155-767675d5a31e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:37:13.744108 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-5dd56dba-3425-409f-8155-767675d5a31e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 20:37:13.744108 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:13.744108 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:13.744108 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:13.744108 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:13.744108 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:13.744108 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:13.744108 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:13.744108 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:13.744108 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:13.744108 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:13.744108 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:13.744108 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:37:13.744108 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:37:13.744108 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:37:13.744108 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:37:13.745054 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:37:13.745054 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:37:13.745054 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:37:13.745054 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:37:13.745054 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:13.745054 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:13.745054 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:13.745054 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:13.745054 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:13.745054 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:13.745054 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:13.745054 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:13.745054 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:13.745054 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:13.745054 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:13.745054 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:13.745830 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:13.745830 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:13.745830 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:13.745830 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:13.745830 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:37:13.745830 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:37:13.745830 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:37:13.745830 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:37:13.745830 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:37:13.745830 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:37:13.745830 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 20:37:13.745830 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:37:13.751940 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 151/305] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jul 15 20:37:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:37:13.753276 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd56dba-3425-409f-8155-767675d5a31e None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:13.762329 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c2eb47-3ae3-45bb-b099-240885b68db1 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:13.817892 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b95ff5-f536-47a3-9b60-6f57a4deb127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:13.818808 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b95ff5-f536-47a3-9b60-6f57a4deb127 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:13.819098 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b95ff5-f536-47a3-9b60-6f57a4deb127 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:13.819981 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b95ff5-f536-47a3-9b60-6f57a4deb127 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:13.822623 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b95ff5-f536-47a3-9b60-6f57a4deb127 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:13.824138 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b95ff5-f536-47a3-9b60-6f57a4deb127 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:13.826117 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 155/306] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jul 15 20:37:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:13.834519 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b95ff5-f536-47a3-9b60-6f57a4deb127 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:13.893228 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd56dba-3425-409f-8155-767675d5a31e None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:13.933894 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f69e891-20f8-487a-8401-50748a0f543a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:13.935186 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f69e891-20f8-487a-8401-50748a0f543a None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:13.935715 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f69e891-20f8-487a-8401-50748a0f543a None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:13.936169 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f69e891-20f8-487a-8401-50748a0f543a None admin] PATH_INFO: `/v3/roles` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:13.937141 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f69e891-20f8-487a-8401-50748a0f543a None admin] RBAC: Adding query filter params (name=reader) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:13.937730 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f69e891-20f8-487a-8401-50748a0f543a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:13.938269 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:13.943440 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f69e891-20f8-487a-8401-50748a0f543a None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:13.954341 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b95ff5-f536-47a3-9b60-6f57a4deb127 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:13.956566 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 152/307] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Jul 15 20:37:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:13.962309 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f69e891-20f8-487a-8401-50748a0f543a None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:13.993520 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d597d8c6-1f01-406a-9511-a3eaa8b52205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:13.994382 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d597d8c6-1f01-406a-9511-a3eaa8b52205 None admin] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:13.994786 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d597d8c6-1f01-406a-9511-a3eaa8b52205 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:13.995130 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d597d8c6-1f01-406a-9511-a3eaa8b52205 None admin] PATH_INFO: `/v3/groups` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:13.995908 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d597d8c6-1f01-406a-9511-a3eaa8b52205 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:13.997503 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d597d8c6-1f01-406a-9511-a3eaa8b52205 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:14.008560 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:14.018966 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 156/308] 10.222.0.16 () {60 vars in 1134 bytes} [Fri Jul 15 20:37:13 2022] POST /identity/v3/groups => generated 229 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 20:37:14.020022 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64539aef-e051-4921-b7a9-e07f687cd25e None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:14.020318 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64539aef-e051-4921-b7a9-e07f687cd25e None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:14.020667 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64539aef-e051-4921-b7a9-e07f687cd25e None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:14.030490 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 157/309] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:37:14 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:37:14.036752 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc22aa-99c5-4d2a-b0d8-7dc7ea1bb23a None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:14.037057 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc22aa-99c5-4d2a-b0d8-7dc7ea1bb23a None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:14.037328 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc22aa-99c5-4d2a-b0d8-7dc7ea1bb23a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:14.058638 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-d4dc22aa-99c5-4d2a-b0d8-7dc7ea1bb23a None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:14.060829 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-d4dc22aa-99c5-4d2a-b0d8-7dc7ea1bb23a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:14.110777 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f69e891-20f8-487a-8401-50748a0f543a None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:14.156568 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 158/310] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:37:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 20:37:14.168072 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec73188b-4ea4-42fc-9761-3fa4cd36d2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:14.169388 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec73188b-4ea4-42fc-9761-3fa4cd36d2c8 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:14.169903 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec73188b-4ea4-42fc-9761-3fa4cd36d2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:14.170403 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec73188b-4ea4-42fc-9761-3fa4cd36d2c8 None admin] PATH_INFO: `/v3/users/5524879312dd4d4d9f1fe3bac7bd988d` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:14.178218 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dc22aa-99c5-4d2a-b0d8-7dc7ea1bb23a None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:14.190155 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec73188b-4ea4-42fc-9761-3fa4cd36d2c8 None admin] RBAC: Authorizing `identity:get_user(user_id=5524879312dd4d4d9f1fe3bac7bd988d)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:14.192238 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec73188b-4ea4-42fc-9761-3fa4cd36d2c8 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:14.196591 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 153/311] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jul 15 20:37:13 2022] GET /identity/v3/users/5524879312dd4d4d9f1fe3bac7bd988d => generated 293 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:37:14.205359 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec73188b-4ea4-42fc-9761-3fa4cd36d2c8 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:14.271898 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:14.316057 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dc22aa-99c5-4d2a-b0d8-7dc7ea1bb23a None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:14.342029 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec73188b-4ea4-42fc-9761-3fa4cd36d2c8 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:14.353663 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:14.366895 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fecba3d-3ec7-46d5-9005-7f5ac1212f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:14.368114 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fecba3d-3ec7-46d5-9005-7f5ac1212f85 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:14.368465 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fecba3d-3ec7-46d5-9005-7f5ac1212f85 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:14.368811 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fecba3d-3ec7-46d5-9005-7f5ac1212f85 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:14.383941 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fecba3d-3ec7-46d5-9005-7f5ac1212f85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:37:14.386349 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df8398-d6f6-40f7-becc-918f6cc938c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:14.387075 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df8398-d6f6-40f7-becc-918f6cc938c3 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:14.387431 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df8398-d6f6-40f7-becc-918f6cc938c3 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:14.387781 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df8398-d6f6-40f7-becc-918f6cc938c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:14.388695 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83df8398-d6f6-40f7-becc-918f6cc938c3 None admin] RBAC: Adding query filter params (role.id=e2a7ac9ae1fe4d4b988ae2dc2c8ab021, user.id=5524879312dd4d4d9f1fe3bac7bd988d, scope.system=all) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:14.389081 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83df8398-d6f6-40f7-becc-918f6cc938c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:14.391246 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83df8398-d6f6-40f7-becc-918f6cc938c3 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:14.394215 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-3fecba3d-3ec7-46d5-9005-7f5ac1212f85 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 20:37:14.394215 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:14.394215 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:14.394215 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:14.394215 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:14.394215 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:14.394215 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:14.394215 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:14.394215 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:14.394215 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:14.394215 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:14.394215 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:14.394215 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:37:14.394215 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:37:14.394215 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:37:14.394215 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:37:14.395094 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:37:14.395094 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:37:14.395094 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:37:14.395094 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:37:14.395094 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:14.395094 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:14.395094 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:14.395094 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:14.395094 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:14.395094 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:14.395094 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:14.395094 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:14.395094 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:14.395094 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:14.395094 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:14.395094 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:14.395853 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:14.395853 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:14.395853 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:14.395853 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:14.395853 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:37:14.395853 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:37:14.395853 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:37:14.395853 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:37:14.395853 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:37:14.395853 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:37:14.395853 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 20:37:14.395853 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:37:14.398069 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 154/312] 10.222.0.16 () {56 vars in 1308 bytes} [Fri Jul 15 20:37:14 2022] GET /identity/v3/role_assignments?user.id=5524879312dd4d4d9f1fe3bac7bd988d&scope.system=all&role.id=e2a7ac9ae1fe4d4b988ae2dc2c8ab021 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:37:14.398465 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 159/313] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jul 15 20:37:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:37:14.410117 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df8398-d6f6-40f7-becc-918f6cc938c3 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:14.545723 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df8398-d6f6-40f7-becc-918f6cc938c3 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:14.559639 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:14.593397 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1168c7f6-058e-437b-b44e-dcd98d52f5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:14.594105 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1168c7f6-058e-437b-b44e-dcd98d52f5d5 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:14.594407 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1168c7f6-058e-437b-b44e-dcd98d52f5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:14.596181 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1168c7f6-058e-437b-b44e-dcd98d52f5d5 None admin] PATH_INFO: `/v3/roles` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:14.597029 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1168c7f6-058e-437b-b44e-dcd98d52f5d5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:14.597634 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1168c7f6-058e-437b-b44e-dcd98d52f5d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:14.602096 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1168c7f6-058e-437b-b44e-dcd98d52f5d5 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:14.612582 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 155/314] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Jul 15 20:37:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:37:14.619308 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fecba3d-3ec7-46d5-9005-7f5ac1212f85 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:14.755965 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fecba3d-3ec7-46d5-9005-7f5ac1212f85 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:14.794584 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aad755e-ce7c-4222-9653-f80af62da0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:14.795469 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad755e-ce7c-4222-9653-f80af62da0d0 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:14.797365 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad755e-ce7c-4222-9653-f80af62da0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:14.797365 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad755e-ce7c-4222-9653-f80af62da0d0 None admin] PATH_INFO: `/v3/users/f1410e6bede9401388b7eb6e39d41e2f` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:14.797365 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aad755e-ce7c-4222-9653-f80af62da0d0 None admin] RBAC: Authorizing `identity:get_user(user_id=f1410e6bede9401388b7eb6e39d41e2f)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:14.798775 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aad755e-ce7c-4222-9653-f80af62da0d0 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:14.800704 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 160/315] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jul 15 20:37:14 2022] GET /identity/v3/users/f1410e6bede9401388b7eb6e39d41e2f => generated 297 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:14.807460 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1168c7f6-058e-437b-b44e-dcd98d52f5d5 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:14.926045 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1168c7f6-058e-437b-b44e-dcd98d52f5d5 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:14.970105 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3b7274-f9d9-4929-ba8f-943a762dba2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:14.970105 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b7274-f9d9-4929-ba8f-943a762dba2d None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:14.970105 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b7274-f9d9-4929-ba8f-943a762dba2d None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:14.970105 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b7274-f9d9-4929-ba8f-943a762dba2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:15.024467 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:15.045888 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3b7274-f9d9-4929-ba8f-943a762dba2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:15.047465 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3b7274-f9d9-4929-ba8f-943a762dba2d None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:15.154479 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 156/316] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jul 15 20:37:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:15.161231 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aad755e-ce7c-4222-9653-f80af62da0d0 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:15.312875 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:15.389485 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aad755e-ce7c-4222-9653-f80af62da0d0 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:15.425130 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c743ce1-51c3-40b9-8b07-bfad17144a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:15.425989 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c743ce1-51c3-40b9-8b07-bfad17144a37 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:15.426317 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c743ce1-51c3-40b9-8b07-bfad17144a37 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:15.426599 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c743ce1-51c3-40b9-8b07-bfad17144a37 None admin] PATH_INFO: `/v3/projects/05cc472462c7477e9894e8c7c170ce4b` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:15.427778 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c743ce1-51c3-40b9-8b07-bfad17144a37 None admin] RBAC: Authorizing `identity:get_project(project_id=05cc472462c7477e9894e8c7c170ce4b)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:15.429236 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c743ce1-51c3-40b9-8b07-bfad17144a37 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:15.435776 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 161/317] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jul 15 20:37:15 2022] GET /identity/v3/projects/05cc472462c7477e9894e8c7c170ce4b => generated 302 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:15.437653 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3b7274-f9d9-4929-ba8f-943a762dba2d None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:15.509045 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:15.541087 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3b7274-f9d9-4929-ba8f-943a762dba2d None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:15.578462 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8d2834-4514-44c7-bdf4-206bcaaee26f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:15.578968 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d2834-4514-44c7-bdf4-206bcaaee26f None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:15.579261 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d2834-4514-44c7-bdf4-206bcaaee26f None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:15.579545 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d2834-4514-44c7-bdf4-206bcaaee26f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:15.580376 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8d2834-4514-44c7-bdf4-206bcaaee26f None admin] RBAC: Adding query filter params (role.id=e2a7ac9ae1fe4d4b988ae2dc2c8ab021, scope.project.id=05cc472462c7477e9894e8c7c170ce4b, user.id=f1410e6bede9401388b7eb6e39d41e2f) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:15.580693 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8d2834-4514-44c7-bdf4-206bcaaee26f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:15.582161 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8d2834-4514-44c7-bdf4-206bcaaee26f None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:15.588547 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 157/318] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jul 15 20:37:15 2022] GET /identity/v3/role_assignments?user.id=f1410e6bede9401388b7eb6e39d41e2f&scope.project.id=05cc472462c7477e9894e8c7c170ce4b&role.id=e2a7ac9ae1fe4d4b988ae2dc2c8ab021 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:16.205474 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab83c9-7ac6-44a9-bc83-24a31f339fbe None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:16.206022 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab83c9-7ac6-44a9-bc83-24a31f339fbe None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:16.206365 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab83c9-7ac6-44a9-bc83-24a31f339fbe None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:16.207775 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 162/319] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:37:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:37:16.216610 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a456caf-c797-4ee8-ae84-7c4030f1a2ef None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:16.217079 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a456caf-c797-4ee8-ae84-7c4030f1a2ef None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:16.217287 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a456caf-c797-4ee8-ae84-7c4030f1a2ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:16.234898 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-6a456caf-c797-4ee8-ae84-7c4030f1a2ef None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:16.236565 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-6a456caf-c797-4ee8-ae84-7c4030f1a2ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:16.305955 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 158/320] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:37:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:37:16.332288 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bab83c9-7ac6-44a9-bc83-24a31f339fbe None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:16.440558 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bab83c9-7ac6-44a9-bc83-24a31f339fbe None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:16.479318 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:16.491123 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f155617f-9a8a-421b-885a-ecdec2d24090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:16.491916 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f155617f-9a8a-421b-885a-ecdec2d24090 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:16.492197 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f155617f-9a8a-421b-885a-ecdec2d24090 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:16.492469 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f155617f-9a8a-421b-885a-ecdec2d24090 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:16.503253 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f155617f-9a8a-421b-885a-ecdec2d24090 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:37:16.510851 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-f155617f-9a8a-421b-885a-ecdec2d24090 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 20:37:16.510851 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:16.510851 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:16.510851 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:16.510851 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:16.510851 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:16.510851 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:16.510851 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:16.510851 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:16.510851 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:16.510851 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:16.510851 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:16.510851 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:37:16.510851 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:37:16.510851 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:37:16.510851 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:37:16.511681 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:37:16.511681 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:37:16.511681 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:37:16.511681 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:37:16.511681 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:16.511681 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:16.511681 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:16.511681 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:16.511681 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:16.511681 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:16.511681 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:16.511681 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:16.511681 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:16.511681 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:16.511681 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:16.511681 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:16.517315 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:16.517315 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:16.517315 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:16.517315 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:16.517315 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:37:16.517315 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:37:16.517315 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:37:16.517315 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:37:16.517315 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:37:16.517315 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:37:16.517315 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 20:37:16.517315 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:37:16.517315 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 163/321] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jul 15 20:37:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 20:37:16.519687 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a456caf-c797-4ee8-ae84-7c4030f1a2ef None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:16.525109 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f7590-2c7d-4e20-b5ba-1385fcccc9a3 None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:16.525401 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f7590-2c7d-4e20-b5ba-1385fcccc9a3 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:16.525685 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f7590-2c7d-4e20-b5ba-1385fcccc9a3 None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:16.527189 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 164/322] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:37:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 20:37:16.531868 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1134026-401b-4232-a9ed-64707556c780 None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:16.532162 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1134026-401b-4232-a9ed-64707556c780 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:16.532570 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1134026-401b-4232-a9ed-64707556c780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:16.550885 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-e1134026-401b-4232-a9ed-64707556c780 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:16.552559 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-e1134026-401b-4232-a9ed-64707556c780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:16.588887 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:16.623743 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 165/323] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:37:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 20:37:16.628062 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a456caf-c797-4ee8-ae84-7c4030f1a2ef None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:16.648147 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1134026-401b-4232-a9ed-64707556c780 None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:16.666645 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f285d3e-926a-4d89-9040-9f9cd2b3e5f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:16.667353 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f285d3e-926a-4d89-9040-9f9cd2b3e5f9 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:16.667639 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f285d3e-926a-4d89-9040-9f9cd2b3e5f9 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:16.667914 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f285d3e-926a-4d89-9040-9f9cd2b3e5f9 None admin] PATH_INFO: `/v3/roles` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:16.668810 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f285d3e-926a-4d89-9040-9f9cd2b3e5f9 None admin] RBAC: Adding query filter params (name=member) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:16.669122 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f285d3e-926a-4d89-9040-9f9cd2b3e5f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:16.670554 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f285d3e-926a-4d89-9040-9f9cd2b3e5f9 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:16.680128 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 159/324] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Jul 15 20:37:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:16.685870 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f285d3e-926a-4d89-9040-9f9cd2b3e5f9 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:16.763856 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1134026-401b-4232-a9ed-64707556c780 None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:16.779542 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:16.795278 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f285d3e-926a-4d89-9040-9f9cd2b3e5f9 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:16.802164 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7846239a-f961-4dc9-83b3-8cbc9dd0a886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:16.802976 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7846239a-f961-4dc9-83b3-8cbc9dd0a886 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:16.803263 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7846239a-f961-4dc9-83b3-8cbc9dd0a886 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:16.803545 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7846239a-f961-4dc9-83b3-8cbc9dd0a886 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:16.804746 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7846239a-f961-4dc9-83b3-8cbc9dd0a886 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:16.806256 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7846239a-f961-4dc9-83b3-8cbc9dd0a886 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:16.807871 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 166/325] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jul 15 20:37:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:37:16.811090 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0070e2da-b68b-4d5a-8e0f-418390efd562 None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:16.811387 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0070e2da-b68b-4d5a-8e0f-418390efd562 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:16.811677 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0070e2da-b68b-4d5a-8e0f-418390efd562 None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:16.813497 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 167/326] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:37:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 20:37:16.814850 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0070e2da-b68b-4d5a-8e0f-418390efd562 None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:16.826145 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:16.834933 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45203dd5-346f-4986-8338-583b7d652e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:16.835800 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45203dd5-346f-4986-8338-583b7d652e59 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:16.836090 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45203dd5-346f-4986-8338-583b7d652e59 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:16.836370 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45203dd5-346f-4986-8338-583b7d652e59 None admin] PATH_INFO: `/v3/users/9f0806cb23b6434da3f56b77e95860cf` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:16.837564 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45203dd5-346f-4986-8338-583b7d652e59 None admin] RBAC: Authorizing `identity:get_user(user_id=9f0806cb23b6434da3f56b77e95860cf)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:16.839032 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45203dd5-346f-4986-8338-583b7d652e59 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:16.840835 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 160/327] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jul 15 20:37:16 2022] GET /identity/v3/users/9f0806cb23b6434da3f56b77e95860cf => generated 293 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:37:16.843511 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe14dfaf-48b1-4457-9071-ebbbf3736276 None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:16.843987 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe14dfaf-48b1-4457-9071-ebbbf3736276 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:16.844431 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe14dfaf-48b1-4457-9071-ebbbf3736276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:16.861314 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-fe14dfaf-48b1-4457-9071-ebbbf3736276 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:16.862527 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-fe14dfaf-48b1-4457-9071-ebbbf3736276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:16.915424 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0070e2da-b68b-4d5a-8e0f-418390efd562 None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:16.928599 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 161/328] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:37:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:37:16.929435 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe14dfaf-48b1-4457-9071-ebbbf3736276 None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:16.950220 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eddb583-c252-451e-8c9f-3d8a2f8d9215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:16.951004 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eddb583-c252-451e-8c9f-3d8a2f8d9215 None admin] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:16.951293 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eddb583-c252-451e-8c9f-3d8a2f8d9215 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:16.951569 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eddb583-c252-451e-8c9f-3d8a2f8d9215 None admin] PATH_INFO: `/v3/groups` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:16.952251 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eddb583-c252-451e-8c9f-3d8a2f8d9215 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:16.954258 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eddb583-c252-451e-8c9f-3d8a2f8d9215 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:16.967210 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 168/329] 10.222.0.16 () {60 vars in 1134 bytes} [Fri Jul 15 20:37:16 2022] POST /identity/v3/groups => generated 226 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:37:16.971020 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eddb583-c252-451e-8c9f-3d8a2f8d9215 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:17.017757 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:17.050545 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe14dfaf-48b1-4457-9071-ebbbf3736276 None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:17.081295 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:17.089966 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eddb583-c252-451e-8c9f-3d8a2f8d9215 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:17.093182 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e37350d-d3fa-4270-b709-68309aea2212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:17.093857 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e37350d-d3fa-4270-b709-68309aea2212 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:17.094183 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e37350d-d3fa-4270-b709-68309aea2212 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:17.094469 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e37350d-d3fa-4270-b709-68309aea2212 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:17.095314 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e37350d-d3fa-4270-b709-68309aea2212 None admin] RBAC: Adding query filter params (role.id=478906d6337444e68ea74da908d9a24d, user.id=9f0806cb23b6434da3f56b77e95860cf, scope.system=all) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:17.095632 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e37350d-d3fa-4270-b709-68309aea2212 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:17.097109 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e37350d-d3fa-4270-b709-68309aea2212 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:17.122113 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 162/330] 10.222.0.16 () {56 vars in 1308 bytes} [Fri Jul 15 20:37:16 2022] GET /identity/v3/role_assignments?user.id=9f0806cb23b6434da3f56b77e95860cf&scope.system=all&role.id=478906d6337444e68ea74da908d9a24d => generated 510 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:17.140061 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f63e5d-6c76-44b8-8f6d-ecd2bec0c84d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:17.141050 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f63e5d-6c76-44b8-8f6d-ecd2bec0c84d None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:17.141340 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f63e5d-6c76-44b8-8f6d-ecd2bec0c84d None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:17.141609 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f63e5d-6c76-44b8-8f6d-ecd2bec0c84d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:17.155891 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f63e5d-6c76-44b8-8f6d-ecd2bec0c84d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:37:17.163955 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-c5f63e5d-6c76-44b8-8f6d-ecd2bec0c84d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 20:37:17.163955 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:17.163955 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:17.163955 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:17.163955 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:17.163955 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:17.163955 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:17.163955 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:17.163955 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:17.163955 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:17.163955 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:17.163955 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:17.163955 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:37:17.163955 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:37:17.163955 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:37:17.163955 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:37:17.164897 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:37:17.164897 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:37:17.164897 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:37:17.164897 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:37:17.164897 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:17.164897 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:17.164897 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:17.164897 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:17.164897 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:17.164897 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:17.164897 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:17.164897 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:17.164897 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:17.164897 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:17.164897 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:17.164897 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:17.165681 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:17.165681 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:17.165681 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:17.165681 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:17.165681 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:37:17.165681 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:37:17.165681 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:37:17.165681 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:37:17.165681 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:37:17.165681 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:37:17.165681 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 20:37:17.165681 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:37:17.165681 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 169/331] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jul 15 20:37:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:37:17.172268 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e37350d-d3fa-4270-b709-68309aea2212 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:17.288739 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e37350d-d3fa-4270-b709-68309aea2212 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:17.326577 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3071e7-7bdc-467b-97ba-f5bf23dd3a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:17.327249 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3071e7-7bdc-467b-97ba-f5bf23dd3a5f None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:17.327580 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3071e7-7bdc-467b-97ba-f5bf23dd3a5f None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:17.327863 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3071e7-7bdc-467b-97ba-f5bf23dd3a5f None admin] PATH_INFO: `/v3/roles` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:17.328626 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3071e7-7bdc-467b-97ba-f5bf23dd3a5f None admin] RBAC: Adding query filter params (name=reader) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:17.328937 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3071e7-7bdc-467b-97ba-f5bf23dd3a5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:17.330392 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3071e7-7bdc-467b-97ba-f5bf23dd3a5f None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:17.340813 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 163/332] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Jul 15 20:37:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:17.346702 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f63e5d-6c76-44b8-8f6d-ecd2bec0c84d None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:17.466708 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f63e5d-6c76-44b8-8f6d-ecd2bec0c84d None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:17.468481 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:17.507244 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbbfdef-378c-48f1-8812-fcaa9cb72bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:17.508126 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbbfdef-378c-48f1-8812-fcaa9cb72bfe None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:17.508413 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbbfdef-378c-48f1-8812-fcaa9cb72bfe None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:17.508691 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbbfdef-378c-48f1-8812-fcaa9cb72bfe None admin] PATH_INFO: `/v3/users/5524879312dd4d4d9f1fe3bac7bd988d` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:17.509964 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbbfdef-378c-48f1-8812-fcaa9cb72bfe None admin] RBAC: Authorizing `identity:get_user(user_id=5524879312dd4d4d9f1fe3bac7bd988d)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:17.511498 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbbfdef-378c-48f1-8812-fcaa9cb72bfe None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:17.513428 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 170/333] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jul 15 20:37:17 2022] GET /identity/v3/users/5524879312dd4d4d9f1fe3bac7bd988d => generated 293 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:17.518954 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3071e7-7bdc-467b-97ba-f5bf23dd3a5f None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:17.572467 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:17.637452 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3071e7-7bdc-467b-97ba-f5bf23dd3a5f None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:17.680974 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a6c98-6628-4953-883d-2c6a99b27745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:17.682244 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a6c98-6628-4953-883d-2c6a99b27745 None admin] REQUEST_METHOD: `PUT` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:17.682738 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a6c98-6628-4953-883d-2c6a99b27745 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:17.683241 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a6c98-6628-4953-883d-2c6a99b27745 None admin] PATH_INFO: `/v3/system/users/5524879312dd4d4d9f1fe3bac7bd988d/roles/e2a7ac9ae1fe4d4b988ae2dc2c8ab021` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:17.685846 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290a6c98-6628-4953-883d-2c6a99b27745 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=5524879312dd4d4d9f1fe3bac7bd988d, role_id=e2a7ac9ae1fe4d4b988ae2dc2c8ab021)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:17.687523 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290a6c98-6628-4953-883d-2c6a99b27745 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:17.705369 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 164/334] 10.222.0.16 () {58 vars in 1334 bytes} [Fri Jul 15 20:37:17 2022] PUT /identity/v3/system/users/5524879312dd4d4d9f1fe3bac7bd988d/roles/e2a7ac9ae1fe4d4b988ae2dc2c8ab021 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:37:19.724131 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba512764-dc23-4a18-9e71-ff2d0bb49801 None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:19.725129 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba512764-dc23-4a18-9e71-ff2d0bb49801 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:19.725653 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba512764-dc23-4a18-9e71-ff2d0bb49801 None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:19.727505 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 171/335] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:37:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:37:19.732528 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c5360-0c19-45d9-b63c-da49b9528982 None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:19.733353 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c5360-0c19-45d9-b63c-da49b9528982 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:19.733961 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c5360-0c19-45d9-b63c-da49b9528982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:19.759284 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-0f6c5360-0c19-45d9-b63c-da49b9528982 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:19.760802 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-0f6c5360-0c19-45d9-b63c-da49b9528982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:19.856605 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 165/336] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:37:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:37:19.906655 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba512764-dc23-4a18-9e71-ff2d0bb49801 None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:20.044973 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba512764-dc23-4a18-9e71-ff2d0bb49801 None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:20.089580 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6454c3f3-c83f-4d19-878a-dd6d29047511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:20.090763 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6454c3f3-c83f-4d19-878a-dd6d29047511 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:20.091274 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6454c3f3-c83f-4d19-878a-dd6d29047511 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:20.091755 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6454c3f3-c83f-4d19-878a-dd6d29047511 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:20.107453 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6454c3f3-c83f-4d19-878a-dd6d29047511 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:37:20.116373 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-6454c3f3-c83f-4d19-878a-dd6d29047511 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 20:37:20.116373 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:20.116373 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:20.116373 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:20.116373 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:20.116373 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:20.116373 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:20.116373 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:20.116373 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:20.116373 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:20.116373 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:20.116373 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:20.116373 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:37:20.116373 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:37:20.116373 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:37:20.116373 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:37:20.117380 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:37:20.117380 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:37:20.117380 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:37:20.117380 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:37:20.117380 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:20.117380 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:20.117380 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:20.117380 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:20.117380 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:20.117380 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:20.117380 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:20.117380 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:20.117380 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:20.117380 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:20.117380 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:20.117380 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:20.118207 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:20.118207 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:20.118207 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:20.118207 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:20.118207 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:37:20.118207 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:37:20.118207 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:37:20.118207 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:37:20.118207 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:37:20.118207 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:37:20.118207 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 20:37:20.118207 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:37:20.120928 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 172/337] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jul 15 20:37:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 20:37:20.129817 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6c5360-0c19-45d9-b63c-da49b9528982 None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:20.193609 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:20.260474 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d12956-1462-48f2-8e81-40262bd4bf81 None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:20.260817 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d12956-1462-48f2-8e81-40262bd4bf81 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:20.261050 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d12956-1462-48f2-8e81-40262bd4bf81 None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:20.262579 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 173/338] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:37:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:37:20.268849 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ae948-16e3-4bf2-a176-3729da2726df None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:20.269858 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ae948-16e3-4bf2-a176-3729da2726df None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:20.274414 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ae948-16e3-4bf2-a176-3729da2726df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:20.274587 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6c5360-0c19-45d9-b63c-da49b9528982 None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:20.314647 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d886604-9325-4855-865d-50184883ca4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:20.315332 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d886604-9325-4855-865d-50184883ca4e None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:20.315627 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d886604-9325-4855-865d-50184883ca4e None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:20.315910 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d886604-9325-4855-865d-50184883ca4e None admin] PATH_INFO: `/v3/roles` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:20.316241 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-876ae948-16e3-4bf2-a176-3729da2726df None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:20.316666 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d886604-9325-4855-865d-50184883ca4e None admin] RBAC: Adding query filter params (name=member) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:20.316980 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d886604-9325-4855-865d-50184883ca4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:20.318115 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-876ae948-16e3-4bf2-a176-3729da2726df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:20.318419 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d886604-9325-4855-865d-50184883ca4e None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:20.328597 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 166/339] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Jul 15 20:37:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:20.330026 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa6556-a5ba-4c0c-b8a2-136696739a28 None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:20.334408 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa6556-a5ba-4c0c-b8a2-136696739a28 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:20.334707 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa6556-a5ba-4c0c-b8a2-136696739a28 None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:20.336396 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 167/340] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:37:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:37:20.337662 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aa6556-a5ba-4c0c-b8a2-136696739a28 None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:20.367935 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:20.469609 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 174/341] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:37:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:37:20.470949 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8d7d4-eba7-4760-8d87-9c87d42e3155 None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:20.471293 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8d7d4-eba7-4760-8d87-9c87d42e3155 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:20.471583 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8d7d4-eba7-4760-8d87-9c87d42e3155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:20.502823 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-ced8d7d4-eba7-4760-8d87-9c87d42e3155 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:20.504077 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-ced8d7d4-eba7-4760-8d87-9c87d42e3155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:20.528944 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aa6556-a5ba-4c0c-b8a2-136696739a28 None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:20.534101 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:20.597882 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38bc127-5422-47d2-a100-75208fc89a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:20.599147 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38bc127-5422-47d2-a100-75208fc89a80 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:20.599810 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38bc127-5422-47d2-a100-75208fc89a80 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:20.600241 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38bc127-5422-47d2-a100-75208fc89a80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:20.625815 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 175/342] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:37:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:37:20.629049 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced8d7d4-eba7-4760-8d87-9c87d42e3155 None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:20.712472 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38bc127-5422-47d2-a100-75208fc89a80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:20.714351 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38bc127-5422-47d2-a100-75208fc89a80 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:20.833153 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 168/343] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jul 15 20:37:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 15 20:37:20.835062 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38bc127-5422-47d2-a100-75208fc89a80 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:20.837920 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:20.852600 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:20.884271 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced8d7d4-eba7-4760-8d87-9c87d42e3155 None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:20.965470 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38bc127-5422-47d2-a100-75208fc89a80 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:20.974907 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e0ae3d-ca1d-4fc2-b62e-e64fbaecf9b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:20.975728 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e0ae3d-ca1d-4fc2-b62e-e64fbaecf9b8 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:20.976022 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e0ae3d-ca1d-4fc2-b62e-e64fbaecf9b8 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:20.976302 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e0ae3d-ca1d-4fc2-b62e-e64fbaecf9b8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:21.004268 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e0ae3d-ca1d-4fc2-b62e-e64fbaecf9b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:37:21.006712 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc79310-e1c8-41b9-988f-56159d5a2671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:21.007741 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc79310-e1c8-41b9-988f-56159d5a2671 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:21.008235 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc79310-e1c8-41b9-988f-56159d5a2671 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:21.008726 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc79310-e1c8-41b9-988f-56159d5a2671 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:21.013041 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-43e0ae3d-ca1d-4fc2-b62e-e64fbaecf9b8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 20:37:21.013041 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:21.013041 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:21.013041 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:21.013041 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:21.013041 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:21.013041 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:21.013041 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:21.013041 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:21.013041 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:21.013041 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:21.013041 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:21.013041 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:37:21.013041 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:37:21.013041 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:37:21.013041 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:37:21.013935 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:37:21.013935 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:37:21.013935 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:37:21.013935 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:37:21.013935 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:21.013935 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:21.013935 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:21.013935 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:21.013935 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:21.013935 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:21.013935 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:21.013935 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:21.013935 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:21.013935 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:21.013935 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:21.013935 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:21.014748 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:21.014748 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:21.014748 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:21.014748 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:21.014748 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:37:21.014748 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:37:21.014748 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:37:21.014748 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:37:21.014748 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:37:21.014748 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:37:21.014748 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 20:37:21.014748 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:37:21.018882 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 176/344] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Jul 15 20:37:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 393 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:37:21.019975 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e0ae3d-ca1d-4fc2-b62e-e64fbaecf9b8 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:21.032781 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc79310-e1c8-41b9-988f-56159d5a2671 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:37:21.049564 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-1cc79310-e1c8-41b9-988f-56159d5a2671 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 20:37:21.049564 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:21.049564 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:21.049564 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:21.049564 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:21.049564 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:21.049564 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:21.049564 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:21.049564 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:21.049564 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:21.049564 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:21.049564 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:21.049564 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:37:21.049564 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:37:21.049564 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:37:21.049564 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:37:21.050519 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:37:21.050519 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:37:21.050519 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:37:21.050519 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:37:21.050519 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:21.050519 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:21.050519 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:21.050519 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:21.050519 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:21.050519 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:21.050519 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:21.050519 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:21.050519 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:21.050519 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:21.050519 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:21.050519 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:21.051336 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:21.051336 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:21.051336 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:21.051336 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:21.051336 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:37:21.051336 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:37:21.051336 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:37:21.051336 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:37:21.051336 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:37:21.051336 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:37:21.051336 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 20:37:21.051336 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:37:21.056467 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 169/345] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jul 15 20:37:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:37:21.058662 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc79310-e1c8-41b9-988f-56159d5a2671 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:21.173133 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:21.183370 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e0ae3d-ca1d-4fc2-b62e-e64fbaecf9b8 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:21.226916 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27d14f2-6743-4e3f-84df-d2d11eaf456a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:21.228160 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27d14f2-6743-4e3f-84df-d2d11eaf456a None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:21.228692 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27d14f2-6743-4e3f-84df-d2d11eaf456a None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:21.229188 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27d14f2-6743-4e3f-84df-d2d11eaf456a None admin] PATH_INFO: `/v3/projects/ce682a869504492d931a06b90986fa49` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:21.230859 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27d14f2-6743-4e3f-84df-d2d11eaf456a None admin] RBAC: Authorizing `identity:get_project(project_id=ce682a869504492d931a06b90986fa49)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:21.232123 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc79310-e1c8-41b9-988f-56159d5a2671 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:21.232814 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27d14f2-6743-4e3f-84df-d2d11eaf456a None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:21.235278 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 177/346] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jul 15 20:37:21 2022] GET /identity/v3/projects/ce682a869504492d931a06b90986fa49 => generated 298 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:21.236458 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27d14f2-6743-4e3f-84df-d2d11eaf456a None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:21.259841 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:21.310781 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429c0f75-e5ef-4fd7-9ea9-c4a16a904f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:21.311459 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c0f75-e5ef-4fd7-9ea9-c4a16a904f41 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:21.312491 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c0f75-e5ef-4fd7-9ea9-c4a16a904f41 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:21.312607 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c0f75-e5ef-4fd7-9ea9-c4a16a904f41 None admin] PATH_INFO: `/v3/roles` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:21.313284 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429c0f75-e5ef-4fd7-9ea9-c4a16a904f41 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:21.313685 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429c0f75-e5ef-4fd7-9ea9-c4a16a904f41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:21.314988 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429c0f75-e5ef-4fd7-9ea9-c4a16a904f41 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:21.340144 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 170/347] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jul 15 20:37:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:21.341002 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429c0f75-e5ef-4fd7-9ea9-c4a16a904f41 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:21.361439 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27d14f2-6743-4e3f-84df-d2d11eaf456a None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:21.413920 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1eac5c-b094-4744-99fd-aabbd349db83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:21.415005 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1eac5c-b094-4744-99fd-aabbd349db83 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:21.416032 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1eac5c-b094-4744-99fd-aabbd349db83 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:21.417312 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1eac5c-b094-4744-99fd-aabbd349db83 None admin] PATH_INFO: `/v3/roles` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:21.418483 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1eac5c-b094-4744-99fd-aabbd349db83 None admin] RBAC: Adding query filter params (name=member) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:21.419011 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1eac5c-b094-4744-99fd-aabbd349db83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:21.421481 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1eac5c-b094-4744-99fd-aabbd349db83 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:21.434198 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 178/348] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Jul 15 20:37:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:21.435339 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1eac5c-b094-4744-99fd-aabbd349db83 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:21.488799 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429c0f75-e5ef-4fd7-9ea9-c4a16a904f41 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:21.521922 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:21.539060 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0849c2-3d4c-4be4-8d36-68239a3cb46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:21.541141 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0849c2-3d4c-4be4-8d36-68239a3cb46f None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:21.541141 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0849c2-3d4c-4be4-8d36-68239a3cb46f None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:21.541141 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0849c2-3d4c-4be4-8d36-68239a3cb46f None admin] PATH_INFO: `/v3/groups/4648830b312942b9ba862afc351c7b82` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:21.550013 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:21.550633 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0849c2-3d4c-4be4-8d36-68239a3cb46f None admin] RBAC: Authorizing `identity:get_group(group_id=4648830b312942b9ba862afc351c7b82)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:21.552270 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0849c2-3d4c-4be4-8d36-68239a3cb46f None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:21.554549 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 171/349] 10.222.0.16 () {56 vars in 1180 bytes} [Fri Jul 15 20:37:21 2022] GET /identity/v3/groups/4648830b312942b9ba862afc351c7b82 => generated 226 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:21.558955 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd001c7-e0a9-4b56-b94e-3d398c1ce979 None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:21.559256 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd001c7-e0a9-4b56-b94e-3d398c1ce979 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:21.559537 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd001c7-e0a9-4b56-b94e-3d398c1ce979 None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:21.561104 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 172/350] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:37:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:37:21.562846 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec3827-d879-4cf0-8c91-28da9a762587 None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:21.563136 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec3827-d879-4cf0-8c91-28da9a762587 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:21.563421 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec3827-d879-4cf0-8c91-28da9a762587 None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:21.564786 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 173/351] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:37:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:37:21.565956 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ec3827-d879-4cf0-8c91-28da9a762587 None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:21.581351 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1eac5c-b094-4744-99fd-aabbd349db83 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:21.631641 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a37c1d8-eed7-4827-b764-93c967b3b119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:21.632574 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a37c1d8-eed7-4827-b764-93c967b3b119 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:21.632865 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a37c1d8-eed7-4827-b764-93c967b3b119 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:21.633150 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a37c1d8-eed7-4827-b764-93c967b3b119 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:21.712859 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ec3827-d879-4cf0-8c91-28da9a762587 None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:21.727729 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a37c1d8-eed7-4827-b764-93c967b3b119 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:21.729059 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a37c1d8-eed7-4827-b764-93c967b3b119 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:21.760235 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2ea28c-c87e-4110-b019-a263eeb7ead7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:21.760899 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ea28c-c87e-4110-b019-a263eeb7ead7 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:21.761193 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ea28c-c87e-4110-b019-a263eeb7ead7 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:21.761477 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ea28c-c87e-4110-b019-a263eeb7ead7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:21.829974 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:21.835778 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:21.847009 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2ea28c-c87e-4110-b019-a263eeb7ead7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:21.848506 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2ea28c-c87e-4110-b019-a263eeb7ead7 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:21.862809 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 179/352] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jul 15 20:37:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:21.864160 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a37c1d8-eed7-4827-b764-93c967b3b119 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:21.985872 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 174/353] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jul 15 20:37:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:21.989014 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba02f0-923b-4113-84de-e62260e53294 None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:21.989014 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba02f0-923b-4113-84de-e62260e53294 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:21.989014 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba02f0-923b-4113-84de-e62260e53294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:22.000043 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a37c1d8-eed7-4827-b764-93c967b3b119 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:22.009700 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-78ba02f0-923b-4113-84de-e62260e53294 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:22.011527 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-78ba02f0-923b-4113-84de-e62260e53294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:22.041079 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2011b39d-c14a-4953-b99f-5e7aed3bf037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:22.041743 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2011b39d-c14a-4953-b99f-5e7aed3bf037 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:22.042028 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2011b39d-c14a-4953-b99f-5e7aed3bf037 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:22.042334 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2011b39d-c14a-4953-b99f-5e7aed3bf037 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:22.043160 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2011b39d-c14a-4953-b99f-5e7aed3bf037 None admin] RBAC: Adding query filter params (group.id=4648830b312942b9ba862afc351c7b82, role.id=478906d6337444e68ea74da908d9a24d, scope.project.id=ce682a869504492d931a06b90986fa49) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:22.043472 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2011b39d-c14a-4953-b99f-5e7aed3bf037 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:22.044911 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2011b39d-c14a-4953-b99f-5e7aed3bf037 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:22.053959 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 180/354] 10.222.0.16 () {56 vars in 1376 bytes} [Fri Jul 15 20:37:21 2022] GET /identity/v3/role_assignments?group.id=4648830b312942b9ba862afc351c7b82&scope.project.id=ce682a869504492d931a06b90986fa49&role.id=478906d6337444e68ea74da908d9a24d => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:22.055405 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86048904-4f0f-4056-9d08-fccd768fc4ec None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:22.055819 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86048904-4f0f-4056-9d08-fccd768fc4ec None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:22.056105 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86048904-4f0f-4056-9d08-fccd768fc4ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:22.078469 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-86048904-4f0f-4056-9d08-fccd768fc4ec None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:22.080044 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-86048904-4f0f-4056-9d08-fccd768fc4ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:22.098775 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 175/355] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:37:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:37:22.107163 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ba02f0-923b-4113-84de-e62260e53294 None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:22.132959 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:22.144568 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:22.173375 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 181/356] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:37:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:37:22.174279 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86048904-4f0f-4056-9d08-fccd768fc4ec None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:22.257899 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ba02f0-923b-4113-84de-e62260e53294 None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:22.300194 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a524b1c5-c988-43bb-b0bd-7e09e254b24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:22.301049 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a524b1c5-c988-43bb-b0bd-7e09e254b24a None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:22.301335 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a524b1c5-c988-43bb-b0bd-7e09e254b24a None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:22.301607 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a524b1c5-c988-43bb-b0bd-7e09e254b24a None admin] PATH_INFO: `/v3/projects/ce682a869504492d931a06b90986fa49` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:22.302326 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86048904-4f0f-4056-9d08-fccd768fc4ec None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:22.303928 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a524b1c5-c988-43bb-b0bd-7e09e254b24a None admin] RBAC: Authorizing `identity:get_project(project_id=ce682a869504492d931a06b90986fa49)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:22.305358 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a524b1c5-c988-43bb-b0bd-7e09e254b24a None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:22.307852 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 176/357] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jul 15 20:37:22 2022] GET /identity/v3/projects/ce682a869504492d931a06b90986fa49 => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:22.314112 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7056f6b7-204c-43b0-9e1c-8e86158015b4 None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:22.314443 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7056f6b7-204c-43b0-9e1c-8e86158015b4 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:22.314721 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7056f6b7-204c-43b0-9e1c-8e86158015b4 None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:22.316201 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 177/358] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:37:22 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:37:22.319805 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7056f6b7-204c-43b0-9e1c-8e86158015b4 None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:22.348494 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f5fc33-fd71-4d1a-85a3-24ec4eba7228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:22.349445 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f5fc33-fd71-4d1a-85a3-24ec4eba7228 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:22.349846 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f5fc33-fd71-4d1a-85a3-24ec4eba7228 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:22.350170 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f5fc33-fd71-4d1a-85a3-24ec4eba7228 None admin] PATH_INFO: `/v3/projects/05cc472462c7477e9894e8c7c170ce4b` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:22.351372 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f5fc33-fd71-4d1a-85a3-24ec4eba7228 None admin] RBAC: Authorizing `identity:get_project(project_id=05cc472462c7477e9894e8c7c170ce4b)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:22.352835 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f5fc33-fd71-4d1a-85a3-24ec4eba7228 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:22.354635 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 182/359] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jul 15 20:37:22 2022] GET /identity/v3/projects/05cc472462c7477e9894e8c7c170ce4b => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:22.355612 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f5fc33-fd71-4d1a-85a3-24ec4eba7228 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:22.413581 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:22.442912 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:22.465020 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7056f6b7-204c-43b0-9e1c-8e86158015b4 None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:22.496292 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f5fc33-fd71-4d1a-85a3-24ec4eba7228 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:22.509517 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa100e-421e-472f-a73b-c8388e9dfac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:22.510700 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa100e-421e-472f-a73b-c8388e9dfac7 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:22.510988 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa100e-421e-472f-a73b-c8388e9dfac7 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:22.511268 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa100e-421e-472f-a73b-c8388e9dfac7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:22.523320 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fa100e-421e-472f-a73b-c8388e9dfac7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:37:22.532104 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-96fa100e-421e-472f-a73b-c8388e9dfac7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 20:37:22.532104 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:22.532104 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:22.532104 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:22.532104 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:22.532104 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:22.532104 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:22.532104 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:22.532104 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:22.532104 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:22.532104 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:22.532104 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:22.532104 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:37:22.532104 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:37:22.532104 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:37:22.532104 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:37:22.532987 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:37:22.532987 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:37:22.532987 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:37:22.532987 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:37:22.532987 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:22.532987 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:22.532987 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:22.532987 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:22.532987 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:22.532987 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:22.532987 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:22.532987 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:22.532987 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:22.532987 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:22.532987 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:22.532987 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:22.533750 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:22.533750 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:22.533750 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:22.533750 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:22.533750 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:37:22.533750 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:37:22.533750 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:37:22.533750 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:37:22.533750 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:37:22.533750 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:37:22.533750 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 20:37:22.533750 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:37:22.533750 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 178/360] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Jul 15 20:37:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:37:22.534500 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa100e-421e-472f-a73b-c8388e9dfac7 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:22.543093 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c908a3d8-ab7e-49df-9e85-fc5742ec75cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:22.543841 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c908a3d8-ab7e-49df-9e85-fc5742ec75cc None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:22.544132 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c908a3d8-ab7e-49df-9e85-fc5742ec75cc None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:22.544409 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c908a3d8-ab7e-49df-9e85-fc5742ec75cc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:22.555937 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c908a3d8-ab7e-49df-9e85-fc5742ec75cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:37:22.565678 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-c908a3d8-ab7e-49df-9e85-fc5742ec75cc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 20:37:22.565678 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:22.565678 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:22.565678 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:22.565678 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:22.565678 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:22.565678 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:22.565678 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:22.565678 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:22.565678 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:22.565678 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:22.565678 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:22.565678 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:37:22.565678 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:37:22.565678 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:37:22.565678 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:37:22.566634 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:37:22.566634 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:37:22.566634 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:37:22.566634 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:37:22.566634 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:22.566634 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:22.566634 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:22.566634 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:22.566634 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:22.566634 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:22.566634 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:22.566634 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:22.566634 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:22.566634 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:22.566634 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:22.566634 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:22.567430 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:22.567430 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:22.567430 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:22.567430 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:22.567430 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:37:22.567430 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:37:22.567430 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:37:22.567430 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:37:22.567430 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:37:22.567430 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:37:22.567430 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 20:37:22.567430 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:37:22.567430 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 183/361] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jul 15 20:37:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:37:22.570104 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc9692e-86a9-4f80-924c-3f48524770be None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:22.570104 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc9692e-86a9-4f80-924c-3f48524770be None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:22.570104 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc9692e-86a9-4f80-924c-3f48524770be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:22.591984 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-8bc9692e-86a9-4f80-924c-3f48524770be None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:22.593831 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-8bc9692e-86a9-4f80-924c-3f48524770be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:22.666609 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa100e-421e-472f-a73b-c8388e9dfac7 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:22.691533 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 184/362] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:37:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:37:22.692687 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc9692e-86a9-4f80-924c-3f48524770be None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:22.709168 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d7a86f-3ed1-4d45-99f2-388f8d15db54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:22.710359 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d7a86f-3ed1-4d45-99f2-388f8d15db54 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:22.710799 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d7a86f-3ed1-4d45-99f2-388f8d15db54 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:22.711257 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d7a86f-3ed1-4d45-99f2-388f8d15db54 None admin] PATH_INFO: `/v3/groups/4648830b312942b9ba862afc351c7b82` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:22.713423 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d7a86f-3ed1-4d45-99f2-388f8d15db54 None admin] RBAC: Authorizing `identity:get_group(group_id=4648830b312942b9ba862afc351c7b82)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:22.715298 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d7a86f-3ed1-4d45-99f2-388f8d15db54 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:22.717621 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 179/363] 10.222.0.16 () {56 vars in 1180 bytes} [Fri Jul 15 20:37:22 2022] GET /identity/v3/groups/4648830b312942b9ba862afc351c7b82 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:22.719166 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d7a86f-3ed1-4d45-99f2-388f8d15db54 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:22.739364 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:22.741492 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:22.831441 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc9692e-86a9-4f80-924c-3f48524770be None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:22.848654 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d7a86f-3ed1-4d45-99f2-388f8d15db54 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:22.872394 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f574b2-1f2b-4af0-b8a5-8113b84b07d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:22.872894 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f574b2-1f2b-4af0-b8a5-8113b84b07d0 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:22.873191 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f574b2-1f2b-4af0-b8a5-8113b84b07d0 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:22.873475 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f574b2-1f2b-4af0-b8a5-8113b84b07d0 None admin] PATH_INFO: `/v3/groups/4648830b312942b9ba862afc351c7b82` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:22.875236 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f574b2-1f2b-4af0-b8a5-8113b84b07d0 None admin] RBAC: Authorizing `identity:get_group(group_id=4648830b312942b9ba862afc351c7b82)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:22.876745 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f574b2-1f2b-4af0-b8a5-8113b84b07d0 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:22.878426 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 185/364] 10.222.0.16 () {56 vars in 1180 bytes} [Fri Jul 15 20:37:22 2022] GET /identity/v3/groups/4648830b312942b9ba862afc351c7b82 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:22.879188 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f574b2-1f2b-4af0-b8a5-8113b84b07d0 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:22.891326 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366e5fd9-ac02-4d4a-9e6f-537e7b995cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:22.892383 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e5fd9-ac02-4d4a-9e6f-537e7b995cd1 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:22.892747 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e5fd9-ac02-4d4a-9e6f-537e7b995cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:22.893130 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e5fd9-ac02-4d4a-9e6f-537e7b995cd1 None admin] PATH_INFO: `/v3/roles` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:22.893890 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366e5fd9-ac02-4d4a-9e6f-537e7b995cd1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:22.894290 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366e5fd9-ac02-4d4a-9e6f-537e7b995cd1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:22.895678 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366e5fd9-ac02-4d4a-9e6f-537e7b995cd1 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:22.909653 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 180/365] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jul 15 20:37:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:22.910694 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366e5fd9-ac02-4d4a-9e6f-537e7b995cd1 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:23.001716 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:23.006560 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f574b2-1f2b-4af0-b8a5-8113b84b07d0 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:23.018509 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:23.046439 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366e5fd9-ac02-4d4a-9e6f-537e7b995cd1 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:23.064382 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bbc5d0-6249-420a-8769-bdb95945dd07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:23.065061 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bbc5d0-6249-420a-8769-bdb95945dd07 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:23.065349 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bbc5d0-6249-420a-8769-bdb95945dd07 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:23.065631 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bbc5d0-6249-420a-8769-bdb95945dd07 None admin] PATH_INFO: `/v3/roles` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:23.067245 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bbc5d0-6249-420a-8769-bdb95945dd07 None admin] RBAC: Adding query filter params (name=reader) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:23.067560 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bbc5d0-6249-420a-8769-bdb95945dd07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:23.068938 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bbc5d0-6249-420a-8769-bdb95945dd07 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:23.079289 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 186/366] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Jul 15 20:37:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:23.080348 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bbc5d0-6249-420a-8769-bdb95945dd07 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:23.090489 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ddb8e7-0525-4986-8a17-00f75eb71877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:23.091623 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ddb8e7-0525-4986-8a17-00f75eb71877 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:23.092458 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ddb8e7-0525-4986-8a17-00f75eb71877 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:23.092985 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ddb8e7-0525-4986-8a17-00f75eb71877 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:23.105546 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ddb8e7-0525-4986-8a17-00f75eb71877 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:37:23.115583 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-64ddb8e7-0525-4986-8a17-00f75eb71877 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:37:23.115583 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:23.115583 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:23.115583 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:23.115583 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:23.115583 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:23.115583 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:23.115583 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:23.115583 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:23.115583 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:23.115583 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:23.115583 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:23.115583 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:37:23.115583 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:37:23.115583 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:37:23.115583 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:37:23.116499 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:37:23.116499 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:37:23.116499 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:37:23.116499 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:37:23.116499 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:23.116499 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:23.116499 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:23.116499 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:23.116499 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:23.116499 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:23.116499 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:23.116499 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:23.116499 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:23.116499 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:23.116499 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:23.116499 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:23.117726 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:23.117726 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:23.117726 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:23.117726 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:23.117726 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:37:23.117726 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:37:23.117726 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:37:23.117726 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:37:23.117726 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:37:23.117726 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:37:23.117726 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:37:23.117726 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:37:23.117726 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 181/367] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Jul 15 20:37:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:37:23.118445 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ddb8e7-0525-4986-8a17-00f75eb71877 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:23.186474 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bbc5d0-6249-420a-8769-bdb95945dd07 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:23.233634 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d779a7fa-6472-4047-b85c-2d79eda0f0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:23.234663 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d779a7fa-6472-4047-b85c-2d79eda0f0ac None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:23.236009 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d779a7fa-6472-4047-b85c-2d79eda0f0ac None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:23.236499 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d779a7fa-6472-4047-b85c-2d79eda0f0ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:23.237602 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d779a7fa-6472-4047-b85c-2d79eda0f0ac None admin] RBAC: Adding query filter params (group.id=4648830b312942b9ba862afc351c7b82, role.id=7deae0ce5d074f488024c63c8ce63928, scope.project.id=ce682a869504492d931a06b90986fa49) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:23.238171 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d779a7fa-6472-4047-b85c-2d79eda0f0ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:23.239838 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d779a7fa-6472-4047-b85c-2d79eda0f0ac None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:23.244350 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ddb8e7-0525-4986-8a17-00f75eb71877 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:23.245987 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 187/368] 10.222.0.16 () {56 vars in 1376 bytes} [Fri Jul 15 20:37:23 2022] GET /identity/v3/role_assignments?group.id=4648830b312942b9ba862afc351c7b82&scope.project.id=ce682a869504492d931a06b90986fa49&role.id=7deae0ce5d074f488024c63c8ce63928 => generated 260 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:23.246973 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d779a7fa-6472-4047-b85c-2d79eda0f0ac None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:23.279520 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:23.293600 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35386129-6ac1-43d0-8125-0ababef505d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:23.294709 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35386129-6ac1-43d0-8125-0ababef505d5 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:23.295336 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35386129-6ac1-43d0-8125-0ababef505d5 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:23.295831 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35386129-6ac1-43d0-8125-0ababef505d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:23.297597 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35386129-6ac1-43d0-8125-0ababef505d5 None admin] RBAC: Adding query filter params (group.id=4648830b312942b9ba862afc351c7b82, role.id=478906d6337444e68ea74da908d9a24d, scope.project.id=05cc472462c7477e9894e8c7c170ce4b) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:23.298271 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35386129-6ac1-43d0-8125-0ababef505d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:23.299999 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35386129-6ac1-43d0-8125-0ababef505d5 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:23.303759 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:23.308513 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 182/369] 10.222.0.16 () {56 vars in 1376 bytes} [Fri Jul 15 20:37:23 2022] GET /identity/v3/role_assignments?group.id=4648830b312942b9ba862afc351c7b82&scope.project.id=05cc472462c7477e9894e8c7c170ce4b&role.id=478906d6337444e68ea74da908d9a24d => generated 260 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:23.309733 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35386129-6ac1-43d0-8125-0ababef505d5 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:23.369411 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d779a7fa-6472-4047-b85c-2d79eda0f0ac None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:23.412488 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c3a43-7868-4699-a464-138fa2b86790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:23.413173 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c3a43-7868-4699-a464-138fa2b86790 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:23.413523 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c3a43-7868-4699-a464-138fa2b86790 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:23.413816 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c3a43-7868-4699-a464-138fa2b86790 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:23.442358 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35386129-6ac1-43d0-8125-0ababef505d5 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:23.485548 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf93d79-9780-4cfa-8f4c-45cd9c211451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:23.486916 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf93d79-9780-4cfa-8f4c-45cd9c211451 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:23.487488 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf93d79-9780-4cfa-8f4c-45cd9c211451 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:23.487970 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf93d79-9780-4cfa-8f4c-45cd9c211451 None admin] PATH_INFO: `/v3/users/5524879312dd4d4d9f1fe3bac7bd988d` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:23.489682 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf93d79-9780-4cfa-8f4c-45cd9c211451 None admin] RBAC: Authorizing `identity:get_user(user_id=5524879312dd4d4d9f1fe3bac7bd988d)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:23.491509 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf93d79-9780-4cfa-8f4c-45cd9c211451 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:23.493594 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 183/370] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jul 15 20:37:23 2022] GET /identity/v3/users/5524879312dd4d4d9f1fe3bac7bd988d => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:23.494767 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf93d79-9780-4cfa-8f4c-45cd9c211451 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:23.495168 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310c3a43-7868-4699-a464-138fa2b86790 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:23.496858 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310c3a43-7868-4699-a464-138fa2b86790 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:23.534651 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:23.610420 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:23.618286 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 188/371] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jul 15 20:37:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:23.619304 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c3a43-7868-4699-a464-138fa2b86790 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:23.670355 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf93d79-9780-4cfa-8f4c-45cd9c211451 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:23.713070 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c081d360-94c8-4082-8269-bfb9812aee77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:23.714102 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c081d360-94c8-4082-8269-bfb9812aee77 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:23.714619 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c081d360-94c8-4082-8269-bfb9812aee77 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:23.715100 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c081d360-94c8-4082-8269-bfb9812aee77 None admin] PATH_INFO: `/v3/roles` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:23.716161 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c081d360-94c8-4082-8269-bfb9812aee77 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:23.716720 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c081d360-94c8-4082-8269-bfb9812aee77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:23.718365 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c081d360-94c8-4082-8269-bfb9812aee77 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:23.729171 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 184/372] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jul 15 20:37:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:23.730373 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c081d360-94c8-4082-8269-bfb9812aee77 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:23.732525 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c3a43-7868-4699-a464-138fa2b86790 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:23.761525 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:23.771902 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806d1d3f-54b0-4c21-a2f6-d421e249b268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:23.772600 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d1d3f-54b0-4c21-a2f6-d421e249b268 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:23.773428 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d1d3f-54b0-4c21-a2f6-d421e249b268 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:23.773917 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d1d3f-54b0-4c21-a2f6-d421e249b268 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:23.776082 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806d1d3f-54b0-4c21-a2f6-d421e249b268 None admin] RBAC: Adding query filter params (role.id=e2a7ac9ae1fe4d4b988ae2dc2c8ab021, user.id=5524879312dd4d4d9f1fe3bac7bd988d, scope.system=all) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:23.776511 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806d1d3f-54b0-4c21-a2f6-d421e249b268 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:23.779220 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806d1d3f-54b0-4c21-a2f6-d421e249b268 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:23.792041 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 189/373] 10.222.0.16 () {56 vars in 1308 bytes} [Fri Jul 15 20:37:23 2022] GET /identity/v3/role_assignments?user.id=5524879312dd4d4d9f1fe3bac7bd988d&scope.system=all&role.id=e2a7ac9ae1fe4d4b988ae2dc2c8ab021 => generated 510 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:23.793049 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806d1d3f-54b0-4c21-a2f6-d421e249b268 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:23.850777 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c081d360-94c8-4082-8269-bfb9812aee77 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:23.884901 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:23.892305 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca58d7c6-c826-404b-9863-84f007fb59a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:23.893595 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca58d7c6-c826-404b-9863-84f007fb59a6 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:23.894031 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca58d7c6-c826-404b-9863-84f007fb59a6 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:23.894497 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca58d7c6-c826-404b-9863-84f007fb59a6 None admin] PATH_INFO: `/v3/projects/05cc472462c7477e9894e8c7c170ce4b` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:23.895928 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca58d7c6-c826-404b-9863-84f007fb59a6 None admin] RBAC: Authorizing `identity:get_project(project_id=05cc472462c7477e9894e8c7c170ce4b)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:23.897776 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca58d7c6-c826-404b-9863-84f007fb59a6 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:23.899747 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 185/374] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jul 15 20:37:23 2022] GET /identity/v3/projects/05cc472462c7477e9894e8c7c170ce4b => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:23.907688 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca58d7c6-c826-404b-9863-84f007fb59a6 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:23.924504 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806d1d3f-54b0-4c21-a2f6-d421e249b268 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:23.967682 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ae2b06-1c65-48f4-a9b8-7c8c704d29a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:23.968738 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae2b06-1c65-48f4-a9b8-7c8c704d29a0 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:23.969381 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae2b06-1c65-48f4-a9b8-7c8c704d29a0 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:23.969866 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae2b06-1c65-48f4-a9b8-7c8c704d29a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:24.023876 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca58d7c6-c826-404b-9863-84f007fb59a6 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:24.035615 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:24.056153 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ae2b06-1c65-48f4-a9b8-7c8c704d29a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:24.058446 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ae2b06-1c65-48f4-a9b8-7c8c704d29a0 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:24.061400 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9e74df-1e4b-41f1-b337-09b185ab1337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:24.063598 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e74df-1e4b-41f1-b337-09b185ab1337 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:24.063598 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e74df-1e4b-41f1-b337-09b185ab1337 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:24.063598 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e74df-1e4b-41f1-b337-09b185ab1337 None admin] PATH_INFO: `/v3/groups/4648830b312942b9ba862afc351c7b82` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:24.064805 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9e74df-1e4b-41f1-b337-09b185ab1337 None admin] RBAC: Authorizing `identity:get_group(group_id=4648830b312942b9ba862afc351c7b82)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:24.066273 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9e74df-1e4b-41f1-b337-09b185ab1337 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:24.070827 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 186/375] 10.222.0.16 () {56 vars in 1180 bytes} [Fri Jul 15 20:37:23 2022] GET /identity/v3/groups/4648830b312942b9ba862afc351c7b82 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:24.091655 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9e74df-1e4b-41f1-b337-09b185ab1337 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:24.177071 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:24.184900 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 190/376] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jul 15 20:37:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:24.190844 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ae2b06-1c65-48f4-a9b8-7c8c704d29a0 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:24.239389 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9e74df-1e4b-41f1-b337-09b185ab1337 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:24.280605 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bf66ca-e6d9-4c57-87ff-7bc8662aa543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:24.281650 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf66ca-e6d9-4c57-87ff-7bc8662aa543 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:24.281944 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf66ca-e6d9-4c57-87ff-7bc8662aa543 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:24.282274 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf66ca-e6d9-4c57-87ff-7bc8662aa543 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:24.283209 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bf66ca-e6d9-4c57-87ff-7bc8662aa543 None admin] RBAC: Adding query filter params (group.id=4648830b312942b9ba862afc351c7b82, role.id=7deae0ce5d074f488024c63c8ce63928, scope.project.id=05cc472462c7477e9894e8c7c170ce4b) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:24.283525 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bf66ca-e6d9-4c57-87ff-7bc8662aa543 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:24.285138 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bf66ca-e6d9-4c57-87ff-7bc8662aa543 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:24.291594 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 187/377] 10.222.0.16 () {56 vars in 1376 bytes} [Fri Jul 15 20:37:24 2022] GET /identity/v3/role_assignments?group.id=4648830b312942b9ba862afc351c7b82&scope.project.id=05cc472462c7477e9894e8c7c170ce4b&role.id=7deae0ce5d074f488024c63c8ce63928 => generated 260 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:37:24.295857 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:24.316232 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ae2b06-1c65-48f4-a9b8-7c8c704d29a0 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:24.356637 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aa71f7-7bb4-456f-a7b9-dea04ee398a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:24.357887 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa71f7-7bb4-456f-a7b9-dea04ee398a4 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:24.358532 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa71f7-7bb4-456f-a7b9-dea04ee398a4 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:24.359002 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa71f7-7bb4-456f-a7b9-dea04ee398a4 None admin] PATH_INFO: `/v3/projects/c5e0cb75b5f34491a7e94518c7bcdb03` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:24.360587 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aa71f7-7bb4-456f-a7b9-dea04ee398a4 None admin] RBAC: Authorizing `identity:get_project(project_id=c5e0cb75b5f34491a7e94518c7bcdb03)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:24.362308 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aa71f7-7bb4-456f-a7b9-dea04ee398a4 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:24.364744 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 191/378] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jul 15 20:37:24 2022] GET /identity/v3/projects/c5e0cb75b5f34491a7e94518c7bcdb03 => generated 344 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:37:24.373553 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bf66ca-e6d9-4c57-87ff-7bc8662aa543 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:24.518557 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bf66ca-e6d9-4c57-87ff-7bc8662aa543 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:24.553220 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:24.565325 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4163a013-dbbc-4ba6-b193-4f0137126e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:24.566254 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163a013-dbbc-4ba6-b193-4f0137126e63 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:24.566557 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163a013-dbbc-4ba6-b193-4f0137126e63 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:24.566839 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163a013-dbbc-4ba6-b193-4f0137126e63 None admin] PATH_INFO: `/v3/groups/ddbaf2bbea7742b2aad7fbdbbf5babe7` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:24.575321 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4163a013-dbbc-4ba6-b193-4f0137126e63 None admin] RBAC: Authorizing `identity:get_group(group_id=ddbaf2bbea7742b2aad7fbdbbf5babe7)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:24.576832 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4163a013-dbbc-4ba6-b193-4f0137126e63 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:24.579574 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 188/379] 10.222.0.16 () {56 vars in 1180 bytes} [Fri Jul 15 20:37:24 2022] GET /identity/v3/groups/ddbaf2bbea7742b2aad7fbdbbf5babe7 => generated 229 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:24.585494 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aa71f7-7bb4-456f-a7b9-dea04ee398a4 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:24.708970 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aa71f7-7bb4-456f-a7b9-dea04ee398a4 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:24.748100 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbce7b7-3f5d-49bd-ab6e-df3b5bd3424f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:24.749758 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbce7b7-3f5d-49bd-ab6e-df3b5bd3424f None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:24.750315 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbce7b7-3f5d-49bd-ab6e-df3b5bd3424f None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:24.750788 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbce7b7-3f5d-49bd-ab6e-df3b5bd3424f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:24.751841 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbce7b7-3f5d-49bd-ab6e-df3b5bd3424f None admin] RBAC: Adding query filter params (group.id=ddbaf2bbea7742b2aad7fbdbbf5babe7, role.id=cbcae224848142ce888ca5b84abfd18e, scope.project.id=c5e0cb75b5f34491a7e94518c7bcdb03) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:24.752368 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbce7b7-3f5d-49bd-ab6e-df3b5bd3424f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:24.754021 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbce7b7-3f5d-49bd-ab6e-df3b5bd3424f None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:24.760882 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 192/380] 10.222.0.16 () {56 vars in 1376 bytes} [Fri Jul 15 20:37:24 2022] GET /identity/v3/role_assignments?group.id=ddbaf2bbea7742b2aad7fbdbbf5babe7&scope.project.id=c5e0cb75b5f34491a7e94518c7bcdb03&role.id=cbcae224848142ce888ca5b84abfd18e => generated 260 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:25.035147 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a9f85-5271-4da4-9b9c-194f160702b5 None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:25.035654 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a9f85-5271-4da4-9b9c-194f160702b5 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:25.035654 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a9f85-5271-4da4-9b9c-194f160702b5 None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:25.037231 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 189/381] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:37:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:37:25.052581 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94ac772-7213-4b2d-a86e-8636cf117f24 None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:25.053581 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94ac772-7213-4b2d-a86e-8636cf117f24 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:25.054061 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94ac772-7213-4b2d-a86e-8636cf117f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:25.077122 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-f94ac772-7213-4b2d-a86e-8636cf117f24 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:25.078818 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-f94ac772-7213-4b2d-a86e-8636cf117f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:25.091561 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:25.154864 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 193/382] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:37:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:37:25.179931 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623a9f85-5271-4da4-9b9c-194f160702b5 None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:25.305893 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623a9f85-5271-4da4-9b9c-194f160702b5 None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:25.341492 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce72c66a-f0df-4c32-85d4-2164b3e41b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:25.343377 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72c66a-f0df-4c32-85d4-2164b3e41b02 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:25.343876 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72c66a-f0df-4c32-85d4-2164b3e41b02 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:25.344352 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72c66a-f0df-4c32-85d4-2164b3e41b02 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:25.355736 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce72c66a-f0df-4c32-85d4-2164b3e41b02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:37:25.364578 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-ce72c66a-f0df-4c32-85d4-2164b3e41b02 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 20:37:25.364578 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:25.364578 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:25.364578 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:25.364578 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:25.364578 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:25.364578 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:25.364578 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:25.364578 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:25.364578 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:25.364578 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:25.364578 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:25.364578 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:37:25.364578 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:37:25.364578 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:37:25.364578 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:37:25.365453 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:37:25.365453 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:37:25.365453 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:37:25.365453 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:37:25.365453 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:25.365453 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:25.365453 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:25.365453 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:25.365453 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:25.365453 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:25.365453 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:25.365453 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:25.365453 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:25.365453 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:25.365453 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:25.365453 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:25.366275 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:25.366275 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:25.366275 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:25.366275 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:25.366275 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:37:25.366275 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:37:25.366275 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:37:25.366275 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:37:25.366275 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:37:25.366275 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:37:25.366275 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 20:37:25.366275 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:37:25.368974 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 190/383] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jul 15 20:37:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:37:25.374714 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94ac772-7213-4b2d-a86e-8636cf117f24 None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:25.506795 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94ac772-7213-4b2d-a86e-8636cf117f24 None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:25.552634 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba22e3c-3985-43ab-94ed-bf15ecf54ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:25.553313 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba22e3c-3985-43ab-94ed-bf15ecf54ac8 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:25.553599 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba22e3c-3985-43ab-94ed-bf15ecf54ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:25.553876 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba22e3c-3985-43ab-94ed-bf15ecf54ac8 None admin] PATH_INFO: `/v3/roles` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:25.554650 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba22e3c-3985-43ab-94ed-bf15ecf54ac8 None admin] RBAC: Adding query filter params (name=member) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:25.554958 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba22e3c-3985-43ab-94ed-bf15ecf54ac8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:25.558555 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba22e3c-3985-43ab-94ed-bf15ecf54ac8 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:25.566247 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 194/384] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Jul 15 20:37:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:25.571241 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce72c66a-f0df-4c32-85d4-2164b3e41b02 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:25.646794 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:25.708952 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce72c66a-f0df-4c32-85d4-2164b3e41b02 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:25.759191 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0288d04-5cdf-43d5-b73c-3160d9b73e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:25.760054 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0288d04-5cdf-43d5-b73c-3160d9b73e50 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:25.760341 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0288d04-5cdf-43d5-b73c-3160d9b73e50 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:25.760620 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0288d04-5cdf-43d5-b73c-3160d9b73e50 None admin] PATH_INFO: `/v3/groups/4648830b312942b9ba862afc351c7b82` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:25.761806 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0288d04-5cdf-43d5-b73c-3160d9b73e50 None admin] RBAC: Authorizing `identity:get_group(group_id=4648830b312942b9ba862afc351c7b82)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:25.763270 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0288d04-5cdf-43d5-b73c-3160d9b73e50 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:25.765603 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 191/385] 10.222.0.16 () {56 vars in 1180 bytes} [Fri Jul 15 20:37:25 2022] GET /identity/v3/groups/4648830b312942b9ba862afc351c7b82 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:25.770892 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba22e3c-3985-43ab-94ed-bf15ecf54ac8 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:25.796493 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:26.004746 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba22e3c-3985-43ab-94ed-bf15ecf54ac8 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:26.054248 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbdb844-1be9-4b92-b847-d46f85d59902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:26.055892 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbdb844-1be9-4b92-b847-d46f85d59902 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:26.056399 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbdb844-1be9-4b92-b847-d46f85d59902 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:26.056895 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbdb844-1be9-4b92-b847-d46f85d59902 None admin] PATH_INFO: `/v3/projects/ce682a869504492d931a06b90986fa49` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:26.058335 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbdb844-1be9-4b92-b847-d46f85d59902 None admin] RBAC: Authorizing `identity:get_project(project_id=ce682a869504492d931a06b90986fa49)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:26.059979 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbdb844-1be9-4b92-b847-d46f85d59902 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:26.062252 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 195/386] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jul 15 20:37:25 2022] GET /identity/v3/projects/ce682a869504492d931a06b90986fa49 => generated 298 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:26.067563 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0288d04-5cdf-43d5-b73c-3160d9b73e50 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:26.229785 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0288d04-5cdf-43d5-b73c-3160d9b73e50 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:26.260743 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:26.273563 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d20161d-9613-486c-8b1c-f9867d96ce11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:26.274528 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d20161d-9613-486c-8b1c-f9867d96ce11 None admin] REQUEST_METHOD: `PUT` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:26.274817 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d20161d-9613-486c-8b1c-f9867d96ce11 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:26.275097 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d20161d-9613-486c-8b1c-f9867d96ce11 None admin] PATH_INFO: `/v3/projects/ce682a869504492d931a06b90986fa49/groups/4648830b312942b9ba862afc351c7b82/roles/478906d6337444e68ea74da908d9a24d` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:26.279328 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d20161d-9613-486c-8b1c-f9867d96ce11 None admin] RBAC: Authorizing `identity:create_grant(project_id=ce682a869504492d931a06b90986fa49, group_id=4648830b312942b9ba862afc351c7b82, role_id=478906d6337444e68ea74da908d9a24d)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:26.281348 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d20161d-9613-486c-8b1c-f9867d96ce11 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:26.306816 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 192/387] 10.222.0.16 () {58 vars in 1442 bytes} [Fri Jul 15 20:37:26 2022] PUT /identity/v3/projects/ce682a869504492d931a06b90986fa49/groups/4648830b312942b9ba862afc351c7b82/roles/478906d6337444e68ea74da908d9a24d => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:37:26.309258 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c3dd4-00e3-40ee-9c47-6141dbdc883f None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:26.309858 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c3dd4-00e3-40ee-9c47-6141dbdc883f None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:26.310379 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c3dd4-00e3-40ee-9c47-6141dbdc883f None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:26.312728 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 196/388] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:37:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:37:26.318994 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a52c7f-94ce-45c1-a032-f8b6d8b3f432 None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:26.319261 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a52c7f-94ce-45c1-a032-f8b6d8b3f432 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:26.319895 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a52c7f-94ce-45c1-a032-f8b6d8b3f432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:26.348037 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-95a52c7f-94ce-45c1-a032-f8b6d8b3f432 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:26.349246 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-95a52c7f-94ce-45c1-a032-f8b6d8b3f432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:26.439845 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 193/389] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:37:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:37:26.478523 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597c3dd4-00e3-40ee-9c47-6141dbdc883f None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:26.493411 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe05c40a-05ba-447a-806b-f5b5b359271d None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:26.493735 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe05c40a-05ba-447a-806b-f5b5b359271d None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:26.493980 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe05c40a-05ba-447a-806b-f5b5b359271d None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:26.495488 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 194/390] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:37:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:37:26.501502 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62917459-1461-4a14-9508-dfe8420c448e None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:26.501707 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62917459-1461-4a14-9508-dfe8420c448e None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:26.501962 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62917459-1461-4a14-9508-dfe8420c448e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:26.525171 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-62917459-1461-4a14-9508-dfe8420c448e None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:26.527206 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-62917459-1461-4a14-9508-dfe8420c448e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:26.630446 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:26.647556 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 195/391] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:37:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 20:37:26.659387 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597c3dd4-00e3-40ee-9c47-6141dbdc883f None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:26.672931 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62917459-1461-4a14-9508-dfe8420c448e None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:26.721153 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1165f76-2688-4e1f-8c69-4ba9a358cfdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:26.721954 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1165f76-2688-4e1f-8c69-4ba9a358cfdb None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:26.722273 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1165f76-2688-4e1f-8c69-4ba9a358cfdb None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:26.722550 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1165f76-2688-4e1f-8c69-4ba9a358cfdb None admin] PATH_INFO: `/v3/roles/member` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:26.746645 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1165f76-2688-4e1f-8c69-4ba9a358cfdb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:37:26.755013 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-c1165f76-2688-4e1f-8c69-4ba9a358cfdb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 20:37:26.755013 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:26.755013 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:26.755013 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:26.755013 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:26.755013 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:26.755013 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:26.755013 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:26.755013 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:26.755013 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:26.755013 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:26.755013 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:26.755013 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:37:26.755013 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:37:26.755013 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:37:26.755013 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:37:26.755899 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:37:26.755899 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:37:26.755899 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:37:26.755899 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:37:26.755899 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:26.755899 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:26.755899 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:26.755899 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:26.755899 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:26.755899 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:26.755899 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:26.755899 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:26.755899 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:26.755899 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:26.755899 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:26.755899 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:26.756673 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:26.756673 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:26.756673 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:26.756673 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:26.756673 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:37:26.756673 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:37:26.756673 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:37:26.756673 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:37:26.756673 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:37:26.756673 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:37:26.756673 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 20:37:26.756673 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:37:26.756673 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 197/392] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jul 15 20:37:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:37:26.762713 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1165f76-2688-4e1f-8c69-4ba9a358cfdb None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:26.768907 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:26.876314 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62917459-1461-4a14-9508-dfe8420c448e None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:26.916248 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1165f76-2688-4e1f-8c69-4ba9a358cfdb None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:26.954748 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf520083-c64a-4cb0-928a-2e065615a329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:26.956431 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf520083-c64a-4cb0-928a-2e065615a329 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:26.956921 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf520083-c64a-4cb0-928a-2e065615a329 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:26.957400 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf520083-c64a-4cb0-928a-2e065615a329 None admin] PATH_INFO: `/v3/roles` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:26.958931 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf520083-c64a-4cb0-928a-2e065615a329 None admin] RBAC: Adding query filter params (name=member) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:26.959767 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf520083-c64a-4cb0-928a-2e065615a329 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:26.962318 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf520083-c64a-4cb0-928a-2e065615a329 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:26.969125 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:26.974484 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 198/393] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Jul 15 20:37:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:26.978206 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab21145-f8e8-4d01-9a56-22076178f0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:26.978206 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab21145-f8e8-4d01-9a56-22076178f0ab None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:26.978206 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab21145-f8e8-4d01-9a56-22076178f0ab None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:26.978206 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab21145-f8e8-4d01-9a56-22076178f0ab None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:26.981497 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf520083-c64a-4cb0-928a-2e065615a329 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:27.002004 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab21145-f8e8-4d01-9a56-22076178f0ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:37:27.022351 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-fab21145-f8e8-4d01-9a56-22076178f0ab None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 20:37:27.022351 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:27.022351 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:27.022351 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:27.022351 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:27.022351 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:27.022351 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:27.022351 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:27.022351 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:27.022351 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:27.022351 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:27.022351 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:27.022351 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:37:27.022351 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:37:27.022351 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:37:27.022351 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:37:27.023318 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:37:27.023318 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:37:27.023318 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:37:27.023318 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:37:27.023318 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:27.023318 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:27.023318 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:27.023318 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:27.023318 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:27.023318 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:27.023318 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:27.023318 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:27.023318 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:27.023318 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:27.023318 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:27.023318 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:27.024098 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:27.024098 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:27.024098 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:27.024098 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:27.024098 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:37:27.024098 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:37:27.024098 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:37:27.024098 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:37:27.024098 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:37:27.024098 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:37:27.024098 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 20:37:27.024098 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:37:27.024098 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 196/394] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Jul 15 20:37:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 20:37:27.035167 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab21145-f8e8-4d01-9a56-22076178f0ab None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:27.113808 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf520083-c64a-4cb0-928a-2e065615a329 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:27.191760 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f872df4e-91aa-4cf9-a810-7ca78e77fe6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:27.192629 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f872df4e-91aa-4cf9-a810-7ca78e77fe6e None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:27.192916 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f872df4e-91aa-4cf9-a810-7ca78e77fe6e None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:27.193195 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f872df4e-91aa-4cf9-a810-7ca78e77fe6e None admin] PATH_INFO: `/v3/groups/4648830b312942b9ba862afc351c7b82` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:27.198854 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f872df4e-91aa-4cf9-a810-7ca78e77fe6e None admin] RBAC: Authorizing `identity:get_group(group_id=4648830b312942b9ba862afc351c7b82)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:27.200343 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f872df4e-91aa-4cf9-a810-7ca78e77fe6e None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:27.203011 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 199/395] 10.222.0.16 () {56 vars in 1180 bytes} [Fri Jul 15 20:37:26 2022] GET /identity/v3/groups/4648830b312942b9ba862afc351c7b82 => generated 226 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:37:27.204011 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7158f84d-063e-412b-af75-146939bfec56 None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:27.204312 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7158f84d-063e-412b-af75-146939bfec56 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:27.208844 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7158f84d-063e-412b-af75-146939bfec56 None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:27.208844 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 200/396] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:37:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:37:27.210498 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7158f84d-063e-412b-af75-146939bfec56 None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:27.214611 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab21145-f8e8-4d01-9a56-22076178f0ab None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:27.216837 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:27.256326 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f290e-6ac3-4ef0-8fc4-39166edb8d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:27.257170 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f290e-6ac3-4ef0-8fc4-39166edb8d99 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:27.257714 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f290e-6ac3-4ef0-8fc4-39166edb8d99 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:27.258089 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f290e-6ac3-4ef0-8fc4-39166edb8d99 None admin] PATH_INFO: `/v3/roles` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:27.259723 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879f290e-6ac3-4ef0-8fc4-39166edb8d99 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:27.260133 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879f290e-6ac3-4ef0-8fc4-39166edb8d99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:27.261612 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879f290e-6ac3-4ef0-8fc4-39166edb8d99 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:27.272288 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 197/397] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jul 15 20:37:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:27.273846 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c0c27-26ca-4751-bf6a-52d77a673917 None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:27.274470 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c0c27-26ca-4751-bf6a-52d77a673917 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:27.274758 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c0c27-26ca-4751-bf6a-52d77a673917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:27.294818 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-a33c0c27-26ca-4751-bf6a-52d77a673917 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:27.296717 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-a33c0c27-26ca-4751-bf6a-52d77a673917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:27.299956 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:27.339271 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7158f84d-063e-412b-af75-146939bfec56 None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:27.378208 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 198/398] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:37:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:37:27.378208 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33c0c27-26ca-4751-bf6a-52d77a673917 None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:27.382628 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08948558-bb48-46f3-9478-c015930c25be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:27.383815 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08948558-bb48-46f3-9478-c015930c25be None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:27.384304 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08948558-bb48-46f3-9478-c015930c25be None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:27.384813 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08948558-bb48-46f3-9478-c015930c25be None admin] PATH_INFO: `/v3/projects/05cc472462c7477e9894e8c7c170ce4b` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:27.386320 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08948558-bb48-46f3-9478-c015930c25be None admin] RBAC: Authorizing `identity:get_project(project_id=05cc472462c7477e9894e8c7c170ce4b)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:27.395035 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08948558-bb48-46f3-9478-c015930c25be None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:27.397420 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 201/399] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jul 15 20:37:27 2022] GET /identity/v3/projects/05cc472462c7477e9894e8c7c170ce4b => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:27.409691 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08948558-bb48-46f3-9478-c015930c25be None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:27.490464 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:27.497696 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33c0c27-26ca-4751-bf6a-52d77a673917 None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:27.521205 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08948558-bb48-46f3-9478-c015930c25be None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:27.533546 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44908e84-fc40-4e34-8c8c-65920b96374a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:27.534461 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44908e84-fc40-4e34-8c8c-65920b96374a None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:27.534751 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44908e84-fc40-4e34-8c8c-65920b96374a None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:27.535032 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44908e84-fc40-4e34-8c8c-65920b96374a None admin] PATH_INFO: `/v3/groups/4648830b312942b9ba862afc351c7b82` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:27.536236 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44908e84-fc40-4e34-8c8c-65920b96374a None admin] RBAC: Authorizing `identity:get_group(group_id=4648830b312942b9ba862afc351c7b82)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:27.537679 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44908e84-fc40-4e34-8c8c-65920b96374a None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:27.539365 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 199/400] 10.222.0.16 () {56 vars in 1180 bytes} [Fri Jul 15 20:37:27 2022] GET /identity/v3/groups/4648830b312942b9ba862afc351c7b82 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:27.540138 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44908e84-fc40-4e34-8c8c-65920b96374a None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:27.563508 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d03a5f5-0cd1-4876-9954-92e4c87828d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:27.564740 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d03a5f5-0cd1-4876-9954-92e4c87828d4 None admin] REQUEST_METHOD: `PUT` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:27.565297 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d03a5f5-0cd1-4876-9954-92e4c87828d4 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:27.565868 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d03a5f5-0cd1-4876-9954-92e4c87828d4 None admin] PATH_INFO: `/v3/projects/05cc472462c7477e9894e8c7c170ce4b/groups/4648830b312942b9ba862afc351c7b82/roles/478906d6337444e68ea74da908d9a24d` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:27.568277 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d03a5f5-0cd1-4876-9954-92e4c87828d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=05cc472462c7477e9894e8c7c170ce4b, group_id=4648830b312942b9ba862afc351c7b82, role_id=478906d6337444e68ea74da908d9a24d)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:27.570315 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d03a5f5-0cd1-4876-9954-92e4c87828d4 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:27.573038 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:27.586933 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 202/401] 10.222.0.16 () {58 vars in 1442 bytes} [Fri Jul 15 20:37:27 2022] PUT /identity/v3/projects/05cc472462c7477e9894e8c7c170ce4b/groups/4648830b312942b9ba862afc351c7b82/roles/478906d6337444e68ea74da908d9a24d => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 20:37:27.588198 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d03a5f5-0cd1-4876-9954-92e4c87828d4 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:27.721268 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d03a5f5-0cd1-4876-9954-92e4c87828d4 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:27.728553 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44908e84-fc40-4e34-8c8c-65920b96374a None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:27.762129 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc35e8fe-8c50-49b0-9a58-f9a1067d6935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:27.763431 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc35e8fe-8c50-49b0-9a58-f9a1067d6935 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:27.763921 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc35e8fe-8c50-49b0-9a58-f9a1067d6935 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:27.764397 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc35e8fe-8c50-49b0-9a58-f9a1067d6935 None admin] PATH_INFO: `/v3/projects/ce682a869504492d931a06b90986fa49` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:27.766587 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc35e8fe-8c50-49b0-9a58-f9a1067d6935 None admin] RBAC: Authorizing `identity:get_project(project_id=ce682a869504492d931a06b90986fa49)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:27.768443 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc35e8fe-8c50-49b0-9a58-f9a1067d6935 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:27.770938 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 203/402] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jul 15 20:37:27 2022] GET /identity/v3/projects/ce682a869504492d931a06b90986fa49 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:27.776422 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc35e8fe-8c50-49b0-9a58-f9a1067d6935 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:27.812613 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074cc9af-5ab9-4fa5-a8a3-58068de4eece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:27.815579 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074cc9af-5ab9-4fa5-a8a3-58068de4eece None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:27.816121 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074cc9af-5ab9-4fa5-a8a3-58068de4eece None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:27.816599 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074cc9af-5ab9-4fa5-a8a3-58068de4eece None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:27.838369 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074cc9af-5ab9-4fa5-a8a3-58068de4eece None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:37:27.850023 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-074cc9af-5ab9-4fa5-a8a3-58068de4eece None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 20:37:27.850023 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:27.850023 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:27.850023 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:27.850023 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:27.850023 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:27.850023 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:27.850023 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:27.850023 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:27.850023 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:27.850023 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:27.850023 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:27.850023 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:37:27.850023 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:37:27.850023 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:37:27.850023 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:37:27.850942 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:37:27.850942 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:37:27.850942 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:37:27.850942 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:37:27.850942 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:27.850942 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:27.850942 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:27.850942 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:27.850942 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:27.850942 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:27.850942 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:27.850942 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:27.850942 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:27.850942 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:27.850942 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:27.850942 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:27.851711 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:27.851711 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:27.851711 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:27.851711 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:27.851711 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:37:27.851711 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:37:27.851711 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:37:27.851711 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:37:27.851711 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:37:27.851711 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:37:27.851711 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 20:37:27.851711 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:37:27.855106 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 200/403] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Jul 15 20:37:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:37:27.861996 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074cc9af-5ab9-4fa5-a8a3-58068de4eece None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:27.880451 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:27.899583 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:27.933949 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc35e8fe-8c50-49b0-9a58-f9a1067d6935 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:27.987714 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecc7a6b-efdb-4133-978d-200e837c30e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:27.988537 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc7a6b-efdb-4133-978d-200e837c30e1 None admin] REQUEST_METHOD: `PUT` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:27.988824 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc7a6b-efdb-4133-978d-200e837c30e1 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:27.989102 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc7a6b-efdb-4133-978d-200e837c30e1 None admin] PATH_INFO: `/v3/projects/ce682a869504492d931a06b90986fa49/groups/4648830b312942b9ba862afc351c7b82/roles/7deae0ce5d074f488024c63c8ce63928` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:27.991420 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecc7a6b-efdb-4133-978d-200e837c30e1 None admin] RBAC: Authorizing `identity:create_grant(project_id=ce682a869504492d931a06b90986fa49, group_id=4648830b312942b9ba862afc351c7b82, role_id=7deae0ce5d074f488024c63c8ce63928)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:27.992917 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecc7a6b-efdb-4133-978d-200e837c30e1 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:28.006182 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074cc9af-5ab9-4fa5-a8a3-58068de4eece None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:28.010942 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 204/404] 10.222.0.16 () {58 vars in 1442 bytes} [Fri Jul 15 20:37:27 2022] PUT /identity/v3/projects/ce682a869504492d931a06b90986fa49/groups/4648830b312942b9ba862afc351c7b82/roles/7deae0ce5d074f488024c63c8ce63928 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:37:28.012183 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfc45c1-35f4-4c7d-8321-500f212b8857 None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:28.012478 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfc45c1-35f4-4c7d-8321-500f212b8857 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:28.012754 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfc45c1-35f4-4c7d-8321-500f212b8857 None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:28.019069 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 205/405] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:37:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:37:28.020925 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d5ca4-11aa-44cf-a60d-bd6dd9b10911 None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:28.021281 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d5ca4-11aa-44cf-a60d-bd6dd9b10911 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:28.021633 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d5ca4-11aa-44cf-a60d-bd6dd9b10911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:28.039414 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-3f9d5ca4-11aa-44cf-a60d-bd6dd9b10911 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:28.040747 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-3f9d5ca4-11aa-44cf-a60d-bd6dd9b10911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:28.055772 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38a8b93-64dc-4ec3-919a-02177b483205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:28.056719 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a8b93-64dc-4ec3-919a-02177b483205 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:28.057013 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a8b93-64dc-4ec3-919a-02177b483205 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:28.057295 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a8b93-64dc-4ec3-919a-02177b483205 None admin] PATH_INFO: `/v3/roles` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:28.058761 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38a8b93-64dc-4ec3-919a-02177b483205 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:28.059350 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38a8b93-64dc-4ec3-919a-02177b483205 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:28.061173 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38a8b93-64dc-4ec3-919a-02177b483205 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:28.078867 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 201/406] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jul 15 20:37:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:28.084297 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38a8b93-64dc-4ec3-919a-02177b483205 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:28.132636 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 206/407] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:37:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:37:28.152739 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9d5ca4-11aa-44cf-a60d-bd6dd9b10911 None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:28.213297 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:28.284266 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9d5ca4-11aa-44cf-a60d-bd6dd9b10911 None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:28.285067 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:28.303062 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38a8b93-64dc-4ec3-919a-02177b483205 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:28.325974 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc1521-f2fc-4920-93ea-d89b14c2a1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:28.326874 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc1521-f2fc-4920-93ea-d89b14c2a1d6 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:28.327084 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc1521-f2fc-4920-93ea-d89b14c2a1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:28.327988 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc1521-f2fc-4920-93ea-d89b14c2a1d6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:28.339568 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dc1521-f2fc-4920-93ea-d89b14c2a1d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:37:28.341236 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7ff3f2-51d6-47a4-a607-01162e877b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:28.342324 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ff3f2-51d6-47a4-a607-01162e877b9b None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:28.342841 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ff3f2-51d6-47a4-a607-01162e877b9b None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:28.343303 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ff3f2-51d6-47a4-a607-01162e877b9b None admin] PATH_INFO: `/v3/groups/4648830b312942b9ba862afc351c7b82` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:28.344646 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7ff3f2-51d6-47a4-a607-01162e877b9b None admin] RBAC: Authorizing `identity:get_group(group_id=4648830b312942b9ba862afc351c7b82)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:28.346302 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7ff3f2-51d6-47a4-a607-01162e877b9b None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:28.347311 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-98dc1521-f2fc-4920-93ea-d89b14c2a1d6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:37:28.347311 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:28.347311 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:28.347311 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:28.347311 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:28.347311 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:28.347311 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:28.347311 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:28.347311 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:28.347311 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:28.347311 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:28.347311 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:28.347311 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:37:28.347311 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:37:28.347311 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:37:28.347311 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:37:28.348278 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:37:28.348278 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:37:28.348278 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:37:28.348278 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:37:28.348278 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:28.348278 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:28.348278 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:28.348278 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:28.348278 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:28.348278 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:28.348278 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:28.348278 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:28.348278 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:28.348278 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:28.348278 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:28.348278 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:28.352919 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:28.352919 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:28.352919 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:28.352919 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:28.352919 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:37:28.352919 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:37:28.352919 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:37:28.352919 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:37:28.352919 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:37:28.352919 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:37:28.352919 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:37:28.352919 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:37:28.352919 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 207/408] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Jul 15 20:37:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 20:37:28.361572 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 202/409] 10.222.0.16 () {56 vars in 1180 bytes} [Fri Jul 15 20:37:28 2022] GET /identity/v3/groups/4648830b312942b9ba862afc351c7b82 => generated 226 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:28.362236 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc1521-f2fc-4920-93ea-d89b14c2a1d6 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:28.363561 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7ff3f2-51d6-47a4-a607-01162e877b9b None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:28.500660 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7ff3f2-51d6-47a4-a607-01162e877b9b None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:28.537506 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0d866f-16f5-419d-abb5-2a70cc1612db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:28.538453 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d866f-16f5-419d-abb5-2a70cc1612db None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:28.538883 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d866f-16f5-419d-abb5-2a70cc1612db None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:28.539310 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d866f-16f5-419d-abb5-2a70cc1612db None admin] PATH_INFO: `/v3/roles` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:28.540198 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0d866f-16f5-419d-abb5-2a70cc1612db None admin] RBAC: Adding query filter params (name=admin) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:28.540650 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0d866f-16f5-419d-abb5-2a70cc1612db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:28.542228 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0d866f-16f5-419d-abb5-2a70cc1612db None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:28.557395 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 203/410] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jul 15 20:37:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:28.560138 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0d866f-16f5-419d-abb5-2a70cc1612db None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:28.585183 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:28.671016 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0d866f-16f5-419d-abb5-2a70cc1612db None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:28.679993 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc1521-f2fc-4920-93ea-d89b14c2a1d6 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:28.708729 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66eac87-19ea-44a6-b663-92070428a4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:28.709594 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66eac87-19ea-44a6-b663-92070428a4d6 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:28.709885 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66eac87-19ea-44a6-b663-92070428a4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:28.710186 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66eac87-19ea-44a6-b663-92070428a4d6 None admin] PATH_INFO: `/v3/groups/ddbaf2bbea7742b2aad7fbdbbf5babe7` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:28.711544 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66eac87-19ea-44a6-b663-92070428a4d6 None admin] RBAC: Authorizing `identity:get_group(group_id=ddbaf2bbea7742b2aad7fbdbbf5babe7)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:28.713050 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66eac87-19ea-44a6-b663-92070428a4d6 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:28.714699 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 204/411] 10.222.0.16 () {56 vars in 1180 bytes} [Fri Jul 15 20:37:28 2022] GET /identity/v3/groups/ddbaf2bbea7742b2aad7fbdbbf5babe7 => generated 229 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:37:28.718711 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:28.721630 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66eac87-19ea-44a6-b663-92070428a4d6 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:28.781897 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d333a2b9-b337-484b-81fc-80977455947f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:28.782797 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d333a2b9-b337-484b-81fc-80977455947f None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:28.783084 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d333a2b9-b337-484b-81fc-80977455947f None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:28.783362 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d333a2b9-b337-484b-81fc-80977455947f None admin] PATH_INFO: `/v3/projects/05cc472462c7477e9894e8c7c170ce4b` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:28.786578 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d333a2b9-b337-484b-81fc-80977455947f None admin] RBAC: Authorizing `identity:get_project(project_id=05cc472462c7477e9894e8c7c170ce4b)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:28.790538 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d333a2b9-b337-484b-81fc-80977455947f None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:28.794848 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 208/412] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jul 15 20:37:28 2022] GET /identity/v3/projects/05cc472462c7477e9894e8c7c170ce4b => generated 302 bytes in 433 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:28.800371 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d333a2b9-b337-484b-81fc-80977455947f None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:28.860280 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:28.887744 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66eac87-19ea-44a6-b663-92070428a4d6 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:28.971588 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707879bc-8218-43f0-a18c-213e0bee8c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:28.972475 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707879bc-8218-43f0-a18c-213e0bee8c57 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:28.972760 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707879bc-8218-43f0-a18c-213e0bee8c57 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:28.973035 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707879bc-8218-43f0-a18c-213e0bee8c57 None admin] PATH_INFO: `/v3/projects/c5e0cb75b5f34491a7e94518c7bcdb03` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:28.974270 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707879bc-8218-43f0-a18c-213e0bee8c57 None admin] RBAC: Authorizing `identity:get_project(project_id=c5e0cb75b5f34491a7e94518c7bcdb03)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:28.975717 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707879bc-8218-43f0-a18c-213e0bee8c57 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:28.986152 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 205/413] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jul 15 20:37:28 2022] GET /identity/v3/projects/c5e0cb75b5f34491a7e94518c7bcdb03 => generated 344 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:28.998854 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707879bc-8218-43f0-a18c-213e0bee8c57 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:29.034987 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d333a2b9-b337-484b-81fc-80977455947f None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:29.081929 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686ec6a6-ab72-445c-8374-1eced11592b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:29.083006 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ec6a6-ab72-445c-8374-1eced11592b2 None admin] REQUEST_METHOD: `PUT` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:29.083601 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ec6a6-ab72-445c-8374-1eced11592b2 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:29.084019 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ec6a6-ab72-445c-8374-1eced11592b2 None admin] PATH_INFO: `/v3/projects/05cc472462c7477e9894e8c7c170ce4b/groups/4648830b312942b9ba862afc351c7b82/roles/7deae0ce5d074f488024c63c8ce63928` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:29.086519 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686ec6a6-ab72-445c-8374-1eced11592b2 None admin] RBAC: Authorizing `identity:create_grant(project_id=05cc472462c7477e9894e8c7c170ce4b, group_id=4648830b312942b9ba862afc351c7b82, role_id=7deae0ce5d074f488024c63c8ce63928)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:29.088476 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686ec6a6-ab72-445c-8374-1eced11592b2 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:29.109137 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 209/414] 10.222.0.16 () {58 vars in 1442 bytes} [Fri Jul 15 20:37:28 2022] PUT /identity/v3/projects/05cc472462c7477e9894e8c7c170ce4b/groups/4648830b312942b9ba862afc351c7b82/roles/7deae0ce5d074f488024c63c8ce63928 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 20:37:29.110741 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ad0315-1f80-45c7-92de-c7a439444277 None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:29.111041 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ad0315-1f80-45c7-92de-c7a439444277 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:29.112029 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ad0315-1f80-45c7-92de-c7a439444277 None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:29.113908 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 210/415] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:37:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:37:29.120193 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74535578-e395-4b7e-840c-c42b14d31aa7 None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:29.120530 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74535578-e395-4b7e-840c-c42b14d31aa7 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:29.120769 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74535578-e395-4b7e-840c-c42b14d31aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:29.131055 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707879bc-8218-43f0-a18c-213e0bee8c57 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:29.138411 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-74535578-e395-4b7e-840c-c42b14d31aa7 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:29.140244 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-74535578-e395-4b7e-840c-c42b14d31aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:29.169662 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef15953-a5ee-45cd-af99-020501334967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:29.170637 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef15953-a5ee-45cd-af99-020501334967 None admin] REQUEST_METHOD: `PUT` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:29.170981 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef15953-a5ee-45cd-af99-020501334967 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:29.171266 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef15953-a5ee-45cd-af99-020501334967 None admin] PATH_INFO: `/v3/projects/c5e0cb75b5f34491a7e94518c7bcdb03/groups/ddbaf2bbea7742b2aad7fbdbbf5babe7/roles/cbcae224848142ce888ca5b84abfd18e` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:29.173304 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef15953-a5ee-45cd-af99-020501334967 None admin] RBAC: Authorizing `identity:create_grant(project_id=c5e0cb75b5f34491a7e94518c7bcdb03, group_id=ddbaf2bbea7742b2aad7fbdbbf5babe7, role_id=cbcae224848142ce888ca5b84abfd18e)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:29.174906 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef15953-a5ee-45cd-af99-020501334967 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:29.180639 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:29.205375 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 206/416] 10.222.0.16 () {58 vars in 1442 bytes} [Fri Jul 15 20:37:28 2022] PUT /identity/v3/projects/c5e0cb75b5f34491a7e94518c7bcdb03/groups/ddbaf2bbea7742b2aad7fbdbbf5babe7/roles/cbcae224848142ce888ca5b84abfd18e => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 20:37:29.233809 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 211/417] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:37:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:37:29.276964 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef15953-a5ee-45cd-af99-020501334967 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:29.299354 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:29.420188 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef15953-a5ee-45cd-af99-020501334967 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:29.462002 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63ceaee-e112-4780-819e-c0fa29e320f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:29.463181 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ceaee-e112-4780-819e-c0fa29e320f9 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:29.463685 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ceaee-e112-4780-819e-c0fa29e320f9 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:29.464163 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ceaee-e112-4780-819e-c0fa29e320f9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:29.475844 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63ceaee-e112-4780-819e-c0fa29e320f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:37:29.483995 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-f63ceaee-e112-4780-819e-c0fa29e320f9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 20:37:29.483995 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:29.483995 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:29.483995 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:29.483995 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:29.483995 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:29.483995 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:29.483995 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:29.483995 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:29.483995 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:29.483995 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:29.483995 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:29.483995 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:37:29.483995 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:37:29.483995 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:37:29.483995 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:37:29.484894 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:37:29.484894 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:37:29.484894 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:37:29.484894 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:37:29.484894 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:29.484894 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:29.484894 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:29.484894 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:29.484894 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:29.484894 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:29.484894 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:29.484894 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:29.484894 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:29.484894 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:29.484894 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:29.484894 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:29.485665 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:29.485665 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:29.485665 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:29.485665 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:29.485665 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:37:29.485665 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:37:29.485665 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:37:29.485665 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:37:29.485665 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:37:29.485665 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:37:29.485665 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 20:37:29.485665 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:37:29.485665 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 207/418] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jul 15 20:37:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:37:29.491025 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74535578-e395-4b7e-840c-c42b14d31aa7 None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:29.614509 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74535578-e395-4b7e-840c-c42b14d31aa7 None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:29.658746 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648c422b-016c-4b3d-9a10-108b45dce869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:29.659424 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c422b-016c-4b3d-9a10-108b45dce869 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:29.659716 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c422b-016c-4b3d-9a10-108b45dce869 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:29.660002 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c422b-016c-4b3d-9a10-108b45dce869 None admin] PATH_INFO: `/v3/roles` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:29.660753 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648c422b-016c-4b3d-9a10-108b45dce869 None admin] RBAC: Adding query filter params (name=member) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:29.661127 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648c422b-016c-4b3d-9a10-108b45dce869 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:29.662548 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648c422b-016c-4b3d-9a10-108b45dce869 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:29.678113 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 212/419] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Jul 15 20:37:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:29.683550 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63ceaee-e112-4780-819e-c0fa29e320f9 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:29.793230 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:29.829134 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63ceaee-e112-4780-819e-c0fa29e320f9 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:29.873761 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b76ce04-4d5f-4caa-9b87-e911f48cdcb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:29.875033 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b76ce04-4d5f-4caa-9b87-e911f48cdcb4 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:29.875317 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b76ce04-4d5f-4caa-9b87-e911f48cdcb4 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:29.875594 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b76ce04-4d5f-4caa-9b87-e911f48cdcb4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:29.967005 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b76ce04-4d5f-4caa-9b87-e911f48cdcb4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:29.968436 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b76ce04-4d5f-4caa-9b87-e911f48cdcb4 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:30.062738 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:30.103439 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 208/420] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jul 15 20:37:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:30.109593 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648c422b-016c-4b3d-9a10-108b45dce869 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:30.170312 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:30.254237 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648c422b-016c-4b3d-9a10-108b45dce869 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:30.289120 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d24ce6-5845-4154-a48a-95a7bd26be87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:30.289983 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d24ce6-5845-4154-a48a-95a7bd26be87 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:30.290295 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d24ce6-5845-4154-a48a-95a7bd26be87 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:30.290572 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d24ce6-5845-4154-a48a-95a7bd26be87 None admin] PATH_INFO: `/v3/projects/ce682a869504492d931a06b90986fa49` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:30.291754 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d24ce6-5845-4154-a48a-95a7bd26be87 None admin] RBAC: Authorizing `identity:get_project(project_id=ce682a869504492d931a06b90986fa49)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:30.293189 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d24ce6-5845-4154-a48a-95a7bd26be87 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:30.295222 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 213/421] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jul 15 20:37:30 2022] GET /identity/v3/projects/ce682a869504492d931a06b90986fa49 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:30.301393 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b76ce04-4d5f-4caa-9b87-e911f48cdcb4 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:30.362956 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f232d14-5484-4071-a7d2-34784b95916f None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:30.363278 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f232d14-5484-4071-a7d2-34784b95916f None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:30.363539 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f232d14-5484-4071-a7d2-34784b95916f None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:30.365443 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 214/422] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:37:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:37:30.372288 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f2640-2249-4fc3-affd-d1b7e9192f64 None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:30.372583 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f2640-2249-4fc3-affd-d1b7e9192f64 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:30.372871 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f2640-2249-4fc3-affd-d1b7e9192f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:30.392373 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-e56f2640-2249-4fc3-affd-d1b7e9192f64 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:30.393586 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-e56f2640-2249-4fc3-affd-d1b7e9192f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:30.447904 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b76ce04-4d5f-4caa-9b87-e911f48cdcb4 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:30.485163 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3885bf7a-d31e-4ceb-8b27-0d94e286e3be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:30.486017 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885bf7a-d31e-4ceb-8b27-0d94e286e3be None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:30.486328 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885bf7a-d31e-4ceb-8b27-0d94e286e3be None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:30.486601 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885bf7a-d31e-4ceb-8b27-0d94e286e3be None admin] PATH_INFO: `/v3/groups/4648830b312942b9ba862afc351c7b82` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:30.487766 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3885bf7a-d31e-4ceb-8b27-0d94e286e3be None admin] RBAC: Authorizing `identity:get_group(group_id=4648830b312942b9ba862afc351c7b82)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:30.489204 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3885bf7a-d31e-4ceb-8b27-0d94e286e3be None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:30.490826 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 209/423] 10.222.0.16 () {56 vars in 1180 bytes} [Fri Jul 15 20:37:30 2022] GET /identity/v3/groups/4648830b312942b9ba862afc351c7b82 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:30.496597 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3885bf7a-d31e-4ceb-8b27-0d94e286e3be None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:30.541838 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:30.588697 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 215/424] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:37:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 20:37:30.611523 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3885bf7a-d31e-4ceb-8b27-0d94e286e3be None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:30.627955 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f2640-2249-4fc3-affd-d1b7e9192f64 None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:30.655125 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba84ad11-dbb5-4cab-8d75-de27508e98e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:30.656492 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84ad11-dbb5-4cab-8d75-de27508e98e9 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:30.656780 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84ad11-dbb5-4cab-8d75-de27508e98e9 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:30.657096 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84ad11-dbb5-4cab-8d75-de27508e98e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:30.658101 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba84ad11-dbb5-4cab-8d75-de27508e98e9 None admin] RBAC: Adding query filter params (group.id=4648830b312942b9ba862afc351c7b82, role.id=478906d6337444e68ea74da908d9a24d, scope.project.id=ce682a869504492d931a06b90986fa49) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:30.658428 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba84ad11-dbb5-4cab-8d75-de27508e98e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:30.660213 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba84ad11-dbb5-4cab-8d75-de27508e98e9 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:30.667078 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 210/425] 10.222.0.16 () {56 vars in 1376 bytes} [Fri Jul 15 20:37:30 2022] GET /identity/v3/role_assignments?group.id=4648830b312942b9ba862afc351c7b82&scope.project.id=ce682a869504492d931a06b90986fa49&role.id=478906d6337444e68ea74da908d9a24d => generated 611 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:37:30.712547 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:30.791744 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2562c639-8eef-4f0d-b547-6d0a36365040 None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:30.792143 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2562c639-8eef-4f0d-b547-6d0a36365040 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:30.792377 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2562c639-8eef-4f0d-b547-6d0a36365040 None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:30.794344 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 211/426] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:37:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:37:30.805310 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606d43db-4936-4c2e-8cb9-ee7da9d62428 None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:30.805941 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606d43db-4936-4c2e-8cb9-ee7da9d62428 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:30.809489 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606d43db-4936-4c2e-8cb9-ee7da9d62428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:30.838814 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f2640-2249-4fc3-affd-d1b7e9192f64 None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:30.843338 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-606d43db-4936-4c2e-8cb9-ee7da9d62428 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:30.844626 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-606d43db-4936-4c2e-8cb9-ee7da9d62428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:30.900493 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d31cb2e-a9ec-48a2-b651-67a5ceb43d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:30.901304 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31cb2e-a9ec-48a2-b651-67a5ceb43d0b None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:30.901590 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31cb2e-a9ec-48a2-b651-67a5ceb43d0b None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:30.901869 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31cb2e-a9ec-48a2-b651-67a5ceb43d0b None admin] PATH_INFO: `/v3/roles/member` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:30.916565 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d31cb2e-a9ec-48a2-b651-67a5ceb43d0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:37:30.924723 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-0d31cb2e-a9ec-48a2-b651-67a5ceb43d0b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 20:37:30.924723 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:30.924723 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:30.924723 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:30.924723 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:30.924723 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:30.924723 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:30.924723 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:30.924723 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:30.924723 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:30.924723 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:30.924723 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:30.924723 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:37:30.924723 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:37:30.924723 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:37:30.924723 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:37:30.925616 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:37:30.925616 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:37:30.925616 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:37:30.925616 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:37:30.925616 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:30.925616 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:30.925616 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:30.925616 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:30.925616 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:30.925616 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:30.925616 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:30.925616 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:30.925616 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:30.925616 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:30.925616 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:30.925616 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:30.926441 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:30.926441 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:30.926441 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:30.926441 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:30.926441 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:37:30.926441 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:37:30.926441 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:37:30.926441 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:37:30.926441 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:37:30.926441 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:37:30.926441 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 20:37:30.926441 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:37:30.927600 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 216/427] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jul 15 20:37:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 20:37:30.932651 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d31cb2e-a9ec-48a2-b651-67a5ceb43d0b None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:30.948512 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 212/428] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:37:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 20:37:30.978005 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606d43db-4936-4c2e-8cb9-ee7da9d62428 None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:31.012110 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:31.041699 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:31.054911 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d31cb2e-a9ec-48a2-b651-67a5ceb43d0b None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:31.095240 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606d43db-4936-4c2e-8cb9-ee7da9d62428 None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:31.097173 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b38649-468d-4800-99e8-8d8e45e2f90e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:31.097929 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b38649-468d-4800-99e8-8d8e45e2f90e None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:31.098473 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b38649-468d-4800-99e8-8d8e45e2f90e None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:31.098825 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b38649-468d-4800-99e8-8d8e45e2f90e None admin] PATH_INFO: `/v3/roles` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:31.099684 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b38649-468d-4800-99e8-8d8e45e2f90e None admin] RBAC: Adding query filter params (name=member) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:31.100068 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b38649-468d-4800-99e8-8d8e45e2f90e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:31.101563 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b38649-468d-4800-99e8-8d8e45e2f90e None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:31.112450 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 217/429] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Jul 15 20:37:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:37:31.118025 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b38649-468d-4800-99e8-8d8e45e2f90e None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:31.134023 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5888dd1e-a276-440f-bf24-036df91404cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:31.135466 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888dd1e-a276-440f-bf24-036df91404cd None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:31.136542 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888dd1e-a276-440f-bf24-036df91404cd None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:31.137138 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888dd1e-a276-440f-bf24-036df91404cd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:31.149080 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5888dd1e-a276-440f-bf24-036df91404cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:37:31.159732 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-5888dd1e-a276-440f-bf24-036df91404cd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 20:37:31.159732 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:31.159732 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:31.159732 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:31.159732 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:31.159732 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:31.159732 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:31.159732 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:31.159732 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:31.159732 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:31.159732 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:31.159732 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:31.159732 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:37:31.159732 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:37:31.159732 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:37:31.159732 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:37:31.160632 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:37:31.160632 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:37:31.160632 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:37:31.160632 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:37:31.160632 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:31.160632 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:31.160632 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:31.160632 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:31.160632 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:31.160632 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:31.160632 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:31.160632 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:31.160632 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:31.160632 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:31.160632 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:31.160632 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:31.161408 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:31.161408 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:31.161408 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:31.161408 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:31.161408 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:37:31.161408 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:37:31.161408 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:37:31.161408 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:37:31.161408 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:37:31.161408 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:37:31.161408 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 20:37:31.161408 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:37:31.168934 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 213/430] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Jul 15 20:37:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 20:37:31.170698 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5888dd1e-a276-440f-bf24-036df91404cd None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:31.242301 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b38649-468d-4800-99e8-8d8e45e2f90e None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:31.281197 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddf2688-9a47-4d27-b8f5-b859da9d159e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:31.281850 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf2688-9a47-4d27-b8f5-b859da9d159e None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:31.282195 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf2688-9a47-4d27-b8f5-b859da9d159e None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:31.282483 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf2688-9a47-4d27-b8f5-b859da9d159e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:31.297795 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:31.311357 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:31.319704 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5888dd1e-a276-440f-bf24-036df91404cd None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:31.357667 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02f4220-76de-438d-b8bf-0e31f2edf10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:31.359097 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f4220-76de-438d-b8bf-0e31f2edf10a None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:31.359384 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f4220-76de-438d-b8bf-0e31f2edf10a None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:31.359659 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f4220-76de-438d-b8bf-0e31f2edf10a None admin] PATH_INFO: `/v3/roles` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:31.360554 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02f4220-76de-438d-b8bf-0e31f2edf10a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:31.361671 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02f4220-76de-438d-b8bf-0e31f2edf10a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:31.363408 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02f4220-76de-438d-b8bf-0e31f2edf10a None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:31.373208 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 214/431] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jul 15 20:37:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:37:31.378955 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02f4220-76de-438d-b8bf-0e31f2edf10a None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:31.380833 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddf2688-9a47-4d27-b8f5-b859da9d159e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:31.382830 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddf2688-9a47-4d27-b8f5-b859da9d159e None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:31.517195 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02f4220-76de-438d-b8bf-0e31f2edf10a None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:31.524408 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 218/432] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jul 15 20:37:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 15 20:37:31.532316 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddf2688-9a47-4d27-b8f5-b859da9d159e None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:31.560371 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a240d83-4099-4fdd-9001-932e32d90f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:31.561706 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a240d83-4099-4fdd-9001-932e32d90f79 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:31.562062 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a240d83-4099-4fdd-9001-932e32d90f79 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:31.562748 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a240d83-4099-4fdd-9001-932e32d90f79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:31.596818 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:31.600819 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:31.660155 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddf2688-9a47-4d27-b8f5-b859da9d159e None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:31.664961 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a240d83-4099-4fdd-9001-932e32d90f79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:31.666460 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a240d83-4099-4fdd-9001-932e32d90f79 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:31.716000 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7748af-ca42-4416-b739-a2bc376d4a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:31.716000 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7748af-ca42-4416-b739-a2bc376d4a68 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:31.716000 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7748af-ca42-4416-b739-a2bc376d4a68 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:31.716944 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7748af-ca42-4416-b739-a2bc376d4a68 None admin] PATH_INFO: `/v3/projects/05cc472462c7477e9894e8c7c170ce4b` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:31.718976 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7748af-ca42-4416-b739-a2bc376d4a68 None admin] RBAC: Authorizing `identity:get_project(project_id=05cc472462c7477e9894e8c7c170ce4b)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:31.720560 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7748af-ca42-4416-b739-a2bc376d4a68 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:31.722673 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 219/433] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jul 15 20:37:31 2022] GET /identity/v3/projects/05cc472462c7477e9894e8c7c170ce4b => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:37:31.727987 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7748af-ca42-4416-b739-a2bc376d4a68 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:31.804523 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 215/434] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jul 15 20:37:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 15 20:37:31.810149 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a240d83-4099-4fdd-9001-932e32d90f79 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:31.874666 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:31.876513 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7748af-ca42-4416-b739-a2bc376d4a68 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:31.907914 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:31.924557 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a4d8ce-7c3e-46ea-b28f-63f58e028c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:31.925472 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4d8ce-7c3e-46ea-b28f-63f58e028c3a None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:31.925698 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4d8ce-7c3e-46ea-b28f-63f58e028c3a None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:31.925978 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4d8ce-7c3e-46ea-b28f-63f58e028c3a None admin] PATH_INFO: `/v3/groups/4648830b312942b9ba862afc351c7b82` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:31.927200 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a4d8ce-7c3e-46ea-b28f-63f58e028c3a None admin] RBAC: Authorizing `identity:get_group(group_id=4648830b312942b9ba862afc351c7b82)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:31.928656 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a4d8ce-7c3e-46ea-b28f-63f58e028c3a None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:31.935514 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 220/435] 10.222.0.16 () {56 vars in 1180 bytes} [Fri Jul 15 20:37:31 2022] GET /identity/v3/groups/4648830b312942b9ba862afc351c7b82 => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:37:31.937036 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a4d8ce-7c3e-46ea-b28f-63f58e028c3a None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:31.940211 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a240d83-4099-4fdd-9001-932e32d90f79 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:31.981253 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d438e-68bf-40ce-a4f3-bff5cf13f120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:31.982185 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d438e-68bf-40ce-a4f3-bff5cf13f120 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:31.982511 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d438e-68bf-40ce-a4f3-bff5cf13f120 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:31.982806 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d438e-68bf-40ce-a4f3-bff5cf13f120 None admin] PATH_INFO: `/v3/projects/ce682a869504492d931a06b90986fa49` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:31.984237 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41d438e-68bf-40ce-a4f3-bff5cf13f120 None admin] RBAC: Authorizing `identity:get_project(project_id=ce682a869504492d931a06b90986fa49)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:31.985834 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41d438e-68bf-40ce-a4f3-bff5cf13f120 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:31.987811 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 216/436] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jul 15 20:37:31 2022] GET /identity/v3/projects/ce682a869504492d931a06b90986fa49 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:37:31.993669 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d438e-68bf-40ce-a4f3-bff5cf13f120 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:32.063332 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a4d8ce-7c3e-46ea-b28f-63f58e028c3a None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:32.098909 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b89e21c-5043-4ce8-b829-3374b850f696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:32.099566 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89e21c-5043-4ce8-b829-3374b850f696 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:32.099856 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89e21c-5043-4ce8-b829-3374b850f696 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:32.100140 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89e21c-5043-4ce8-b829-3374b850f696 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:32.100968 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b89e21c-5043-4ce8-b829-3374b850f696 None admin] RBAC: Adding query filter params (group.id=4648830b312942b9ba862afc351c7b82, role.id=478906d6337444e68ea74da908d9a24d, scope.project.id=05cc472462c7477e9894e8c7c170ce4b) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:32.101284 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b89e21c-5043-4ce8-b829-3374b850f696 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:32.102232 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d438e-68bf-40ce-a4f3-bff5cf13f120 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:32.102918 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b89e21c-5043-4ce8-b829-3374b850f696 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:32.118101 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 221/437] 10.222.0.16 () {56 vars in 1376 bytes} [Fri Jul 15 20:37:31 2022] GET /identity/v3/role_assignments?group.id=4648830b312942b9ba862afc351c7b82&scope.project.id=05cc472462c7477e9894e8c7c170ce4b&role.id=478906d6337444e68ea74da908d9a24d => generated 611 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:32.118101 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68efeaf-697b-40eb-8028-40e772f2aa12 None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:32.118101 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68efeaf-697b-40eb-8028-40e772f2aa12 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:32.118101 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68efeaf-697b-40eb-8028-40e772f2aa12 None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:32.118101 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 222/438] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:37:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:37:32.118863 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff2ef5-a17a-412c-a308-f5cb2cab9832 None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:32.118967 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff2ef5-a17a-412c-a308-f5cb2cab9832 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:32.119276 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff2ef5-a17a-412c-a308-f5cb2cab9832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:32.138346 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:32.138526 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-75ff2ef5-a17a-412c-a308-f5cb2cab9832 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:32.140984 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-75ff2ef5-a17a-412c-a308-f5cb2cab9832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:32.151518 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0d38c4-4419-446e-8ad2-2e27b709a310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:32.152400 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d38c4-4419-446e-8ad2-2e27b709a310 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:32.152692 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d38c4-4419-446e-8ad2-2e27b709a310 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:32.152976 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d38c4-4419-446e-8ad2-2e27b709a310 None admin] PATH_INFO: `/v3/groups/4648830b312942b9ba862afc351c7b82` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:32.154280 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0d38c4-4419-446e-8ad2-2e27b709a310 None admin] RBAC: Authorizing `identity:get_group(group_id=4648830b312942b9ba862afc351c7b82)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:32.155831 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0d38c4-4419-446e-8ad2-2e27b709a310 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:32.162351 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 217/439] 10.222.0.16 () {56 vars in 1180 bytes} [Fri Jul 15 20:37:31 2022] GET /identity/v3/groups/4648830b312942b9ba862afc351c7b82 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:32.162351 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f83160-853c-4d8b-a17e-31c11998db4b None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:32.162351 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f83160-853c-4d8b-a17e-31c11998db4b None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:32.162351 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f83160-853c-4d8b-a17e-31c11998db4b None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:32.162351 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 218/440] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:37:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:37:32.166298 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f83160-853c-4d8b-a17e-31c11998db4b None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:32.206831 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:32.231127 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 223/441] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:37:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 20:37:32.232699 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e40d13a-28d9-4f2a-b62b-d66f56daa206 None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:32.233135 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e40d13a-28d9-4f2a-b62b-d66f56daa206 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:32.233591 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e40d13a-28d9-4f2a-b62b-d66f56daa206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:32.252082 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-5e40d13a-28d9-4f2a-b62b-d66f56daa206 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:32.254111 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-5e40d13a-28d9-4f2a-b62b-d66f56daa206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:32.299246 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f83160-853c-4d8b-a17e-31c11998db4b None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:32.333849 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 224/442] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:37:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:37:32.334767 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e40d13a-28d9-4f2a-b62b-d66f56daa206 None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:32.351046 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d865a01-5551-4e7e-8a90-4debb3ca0891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:32.351585 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d865a01-5551-4e7e-8a90-4debb3ca0891 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:32.351810 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d865a01-5551-4e7e-8a90-4debb3ca0891 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:32.352090 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d865a01-5551-4e7e-8a90-4debb3ca0891 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:32.352931 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d865a01-5551-4e7e-8a90-4debb3ca0891 None admin] RBAC: Adding query filter params (group.id=4648830b312942b9ba862afc351c7b82, role.id=7deae0ce5d074f488024c63c8ce63928, scope.project.id=ce682a869504492d931a06b90986fa49) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:32.353232 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d865a01-5551-4e7e-8a90-4debb3ca0891 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:32.354828 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d865a01-5551-4e7e-8a90-4debb3ca0891 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:32.366102 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 219/443] 10.222.0.16 () {56 vars in 1376 bytes} [Fri Jul 15 20:37:32 2022] GET /identity/v3/role_assignments?group.id=4648830b312942b9ba862afc351c7b82&scope.project.id=ce682a869504492d931a06b90986fa49&role.id=7deae0ce5d074f488024c63c8ce63928 => generated 611 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:32.366102 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d865a01-5551-4e7e-8a90-4debb3ca0891 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:32.431626 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:32.464284 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e40d13a-28d9-4f2a-b62b-d66f56daa206 None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:32.480775 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:32.493084 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d865a01-5551-4e7e-8a90-4debb3ca0891 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:32.506547 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f33264-82be-43fa-a761-604858427ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:32.507634 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f33264-82be-43fa-a761-604858427ccc None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:32.508274 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f33264-82be-43fa-a761-604858427ccc None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:32.508509 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f33264-82be-43fa-a761-604858427ccc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:32.521639 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f33264-82be-43fa-a761-604858427ccc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:37:32.529502 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efefab00-e6df-4c88-a835-fc09fa03edcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:32.530475 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efefab00-e6df-4c88-a835-fc09fa03edcc None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:32.530769 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efefab00-e6df-4c88-a835-fc09fa03edcc None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:32.530914 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-c7f33264-82be-43fa-a761-604858427ccc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 20:37:32.530914 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:32.530914 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:32.530914 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:32.530914 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:32.530914 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:32.530914 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:32.530914 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:32.530914 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:32.530914 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:32.530914 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:32.530914 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:32.530914 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:37:32.530914 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:37:32.530914 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:37:32.530914 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:37:32.531909 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:37:32.531909 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:37:32.531909 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:37:32.531909 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:37:32.531909 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:32.531909 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:32.531909 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:32.531909 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:32.531909 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:32.531909 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:32.531909 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:32.531909 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:32.531909 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:32.531909 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:32.531909 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:32.531909 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:32.532854 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:32.532854 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:32.532854 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:32.532854 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:32.532854 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:37:32.532854 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:37:32.532854 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:37:32.532854 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:37:32.532854 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:37:32.532854 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:37:32.532854 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 20:37:32.532854 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:37:32.533526 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efefab00-e6df-4c88-a835-fc09fa03edcc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:32.533605 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 225/444] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Jul 15 20:37:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:37:32.539014 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f33264-82be-43fa-a761-604858427ccc None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:32.545032 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efefab00-e6df-4c88-a835-fc09fa03edcc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:37:32.552881 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-efefab00-e6df-4c88-a835-fc09fa03edcc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:37:32.552881 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:32.552881 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:32.552881 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:32.552881 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:32.552881 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:32.552881 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:32.552881 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:32.552881 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:32.552881 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:32.552881 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:32.552881 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:32.552881 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:37:32.552881 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:37:32.552881 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:37:32.552881 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:37:32.553794 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:37:32.553794 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:37:32.553794 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:37:32.553794 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:37:32.553794 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:32.553794 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:32.553794 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:32.553794 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:32.553794 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:32.553794 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:32.553794 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:32.553794 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:32.553794 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:32.553794 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:32.553794 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:32.553794 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:32.554637 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:32.554637 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:32.554637 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:32.554637 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:32.554637 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:37:32.554637 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:37:32.554637 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:37:32.554637 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:37:32.554637 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:37:32.554637 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:37:32.554637 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:37:32.554637 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:37:32.554637 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 220/445] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Jul 15 20:37:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:37:32.560339 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efefab00-e6df-4c88-a835-fc09fa03edcc None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:32.663571 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f33264-82be-43fa-a761-604858427ccc None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:32.692853 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efefab00-e6df-4c88-a835-fc09fa03edcc None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:32.701686 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9083070-bf31-43ea-bc0d-7fdce52876ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:32.703075 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9083070-bf31-43ea-bc0d-7fdce52876ce None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:32.703360 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9083070-bf31-43ea-bc0d-7fdce52876ce None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:32.703639 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9083070-bf31-43ea-bc0d-7fdce52876ce None admin] PATH_INFO: `/v3/roles` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:32.704390 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9083070-bf31-43ea-bc0d-7fdce52876ce None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:32.704694 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9083070-bf31-43ea-bc0d-7fdce52876ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:32.706335 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9083070-bf31-43ea-bc0d-7fdce52876ce None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:32.708948 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:32.715619 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 226/446] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jul 15 20:37:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:32.722291 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9083070-bf31-43ea-bc0d-7fdce52876ce None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:32.735465 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db43be05-7082-49aa-8f1a-dae807ce91d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:32.736146 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db43be05-7082-49aa-8f1a-dae807ce91d0 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:32.736437 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db43be05-7082-49aa-8f1a-dae807ce91d0 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:32.736725 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db43be05-7082-49aa-8f1a-dae807ce91d0 None admin] PATH_INFO: `/v3/roles` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:32.737483 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db43be05-7082-49aa-8f1a-dae807ce91d0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:32.737797 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db43be05-7082-49aa-8f1a-dae807ce91d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:32.741847 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db43be05-7082-49aa-8f1a-dae807ce91d0 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:32.749922 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 221/447] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jul 15 20:37:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:37:32.756023 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db43be05-7082-49aa-8f1a-dae807ce91d0 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:32.767776 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:32.849366 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9083070-bf31-43ea-bc0d-7fdce52876ce None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:32.876278 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db43be05-7082-49aa-8f1a-dae807ce91d0 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:32.891719 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7906218d-3c76-4ce2-8764-1f93d4dad701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:32.892653 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7906218d-3c76-4ce2-8764-1f93d4dad701 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:32.892940 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7906218d-3c76-4ce2-8764-1f93d4dad701 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:32.893215 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7906218d-3c76-4ce2-8764-1f93d4dad701 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:32.913979 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b3c060-b44f-4c18-ad9b-3e58f698aebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:32.914670 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b3c060-b44f-4c18-ad9b-3e58f698aebb None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:32.914964 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b3c060-b44f-4c18-ad9b-3e58f698aebb None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:32.915246 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b3c060-b44f-4c18-ad9b-3e58f698aebb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:32.961074 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:32.964987 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7906218d-3c76-4ce2-8764-1f93d4dad701 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:32.966490 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7906218d-3c76-4ce2-8764-1f93d4dad701 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:32.984726 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b3c060-b44f-4c18-ad9b-3e58f698aebb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:32.986223 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b3c060-b44f-4c18-ad9b-3e58f698aebb None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:32.998113 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:33.065101 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 227/448] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jul 15 20:37:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 15 20:37:33.070914 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7906218d-3c76-4ce2-8764-1f93d4dad701 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:33.084287 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 222/449] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jul 15 20:37:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:33.089779 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b3c060-b44f-4c18-ad9b-3e58f698aebb None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:33.162959 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:33.167077 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7906218d-3c76-4ce2-8764-1f93d4dad701 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:33.186230 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b3c060-b44f-4c18-ad9b-3e58f698aebb None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:33.200624 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6001b6b-507d-456f-9d2f-9be176bc2761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:33.201472 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6001b6b-507d-456f-9d2f-9be176bc2761 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:33.201756 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6001b6b-507d-456f-9d2f-9be176bc2761 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:33.202126 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6001b6b-507d-456f-9d2f-9be176bc2761 None admin] PATH_INFO: `/v3/projects/05cc472462c7477e9894e8c7c170ce4b` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:33.203367 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6001b6b-507d-456f-9d2f-9be176bc2761 None admin] RBAC: Authorizing `identity:get_project(project_id=05cc472462c7477e9894e8c7c170ce4b)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:33.204802 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6001b6b-507d-456f-9d2f-9be176bc2761 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:33.206544 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 228/450] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jul 15 20:37:33 2022] GET /identity/v3/projects/05cc472462c7477e9894e8c7c170ce4b => generated 302 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:37:33.212924 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6001b6b-507d-456f-9d2f-9be176bc2761 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:33.215608 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:33.228854 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5957659e-774c-477a-9ce4-f65e7696a139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:33.229713 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5957659e-774c-477a-9ce4-f65e7696a139 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:33.230000 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5957659e-774c-477a-9ce4-f65e7696a139 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:33.230312 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5957659e-774c-477a-9ce4-f65e7696a139 None admin] PATH_INFO: `/v3/projects/c5e0cb75b5f34491a7e94518c7bcdb03` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:33.231491 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5957659e-774c-477a-9ce4-f65e7696a139 None admin] RBAC: Authorizing `identity:get_project(project_id=c5e0cb75b5f34491a7e94518c7bcdb03)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:33.232924 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5957659e-774c-477a-9ce4-f65e7696a139 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:33.235121 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 223/451] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jul 15 20:37:33 2022] GET /identity/v3/projects/c5e0cb75b5f34491a7e94518c7bcdb03 => generated 344 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:37:33.240546 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5957659e-774c-477a-9ce4-f65e7696a139 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:33.311203 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6001b6b-507d-456f-9d2f-9be176bc2761 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:33.337832 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5957659e-774c-477a-9ce4-f65e7696a139 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:33.345580 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf029eb-d0a3-4a7e-82b2-c5c07ac6e1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:33.346463 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf029eb-d0a3-4a7e-82b2-c5c07ac6e1af None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:33.346748 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf029eb-d0a3-4a7e-82b2-c5c07ac6e1af None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:33.347025 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf029eb-d0a3-4a7e-82b2-c5c07ac6e1af None admin] PATH_INFO: `/v3/groups/4648830b312942b9ba862afc351c7b82` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:33.348201 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf029eb-d0a3-4a7e-82b2-c5c07ac6e1af None admin] RBAC: Authorizing `identity:get_group(group_id=4648830b312942b9ba862afc351c7b82)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:33.349635 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf029eb-d0a3-4a7e-82b2-c5c07ac6e1af None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:33.351274 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 229/452] 10.222.0.16 () {56 vars in 1180 bytes} [Fri Jul 15 20:37:33 2022] GET /identity/v3/groups/4648830b312942b9ba862afc351c7b82 => generated 226 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:37:33.356935 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf029eb-d0a3-4a7e-82b2-c5c07ac6e1af None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:33.371929 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cce4d21-286b-4a45-8f1c-27fca5d704e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:33.372774 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce4d21-286b-4a45-8f1c-27fca5d704e1 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:33.373062 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce4d21-286b-4a45-8f1c-27fca5d704e1 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:33.373342 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce4d21-286b-4a45-8f1c-27fca5d704e1 None admin] PATH_INFO: `/v3/groups/ddbaf2bbea7742b2aad7fbdbbf5babe7` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:33.374664 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cce4d21-286b-4a45-8f1c-27fca5d704e1 None admin] RBAC: Authorizing `identity:get_group(group_id=ddbaf2bbea7742b2aad7fbdbbf5babe7)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:33.376084 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cce4d21-286b-4a45-8f1c-27fca5d704e1 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:33.377679 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 224/453] 10.222.0.16 () {56 vars in 1180 bytes} [Fri Jul 15 20:37:33 2022] GET /identity/v3/groups/ddbaf2bbea7742b2aad7fbdbbf5babe7 => generated 229 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:37:33.383286 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cce4d21-286b-4a45-8f1c-27fca5d704e1 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:33.399218 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:33.430637 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:33.463268 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf029eb-d0a3-4a7e-82b2-c5c07ac6e1af None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:33.489180 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cce4d21-286b-4a45-8f1c-27fca5d704e1 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:33.499000 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe09a10-e199-4b76-a7c1-90ddabffe96a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:33.499658 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe09a10-e199-4b76-a7c1-90ddabffe96a None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:33.499944 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe09a10-e199-4b76-a7c1-90ddabffe96a None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:33.500223 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe09a10-e199-4b76-a7c1-90ddabffe96a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:33.501050 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe09a10-e199-4b76-a7c1-90ddabffe96a None admin] RBAC: Adding query filter params (group.id=4648830b312942b9ba862afc351c7b82, role.id=7deae0ce5d074f488024c63c8ce63928, scope.project.id=05cc472462c7477e9894e8c7c170ce4b) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:33.501361 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe09a10-e199-4b76-a7c1-90ddabffe96a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:33.502836 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe09a10-e199-4b76-a7c1-90ddabffe96a None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:33.508854 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 230/454] 10.222.0.16 () {56 vars in 1376 bytes} [Fri Jul 15 20:37:33 2022] GET /identity/v3/role_assignments?group.id=4648830b312942b9ba862afc351c7b82&scope.project.id=05cc472462c7477e9894e8c7c170ce4b&role.id=7deae0ce5d074f488024c63c8ce63928 => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:37:33.526403 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a81a63-df0a-41e6-9add-54494eead509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:33.527074 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a81a63-df0a-41e6-9add-54494eead509 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:33.527360 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a81a63-df0a-41e6-9add-54494eead509 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:33.527645 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a81a63-df0a-41e6-9add-54494eead509 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:33.528484 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a81a63-df0a-41e6-9add-54494eead509 None admin] RBAC: Adding query filter params (group.id=ddbaf2bbea7742b2aad7fbdbbf5babe7, role.id=cbcae224848142ce888ca5b84abfd18e, scope.project.id=c5e0cb75b5f34491a7e94518c7bcdb03) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:33.528801 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a81a63-df0a-41e6-9add-54494eead509 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:33.530896 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a81a63-df0a-41e6-9add-54494eead509 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:33.537553 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 225/455] 10.222.0.16 () {56 vars in 1376 bytes} [Fri Jul 15 20:37:33 2022] GET /identity/v3/role_assignments?group.id=ddbaf2bbea7742b2aad7fbdbbf5babe7&scope.project.id=c5e0cb75b5f34491a7e94518c7bcdb03&role.id=cbcae224848142ce888ca5b84abfd18e => generated 611 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:37:36.216123 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a6842-2577-423a-94ae-f93f0fed9ea7 None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:36.216658 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a6842-2577-423a-94ae-f93f0fed9ea7 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:36.216658 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a6842-2577-423a-94ae-f93f0fed9ea7 None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:36.218935 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 231/456] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:37:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:37:36.224815 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee743d-ac2e-4124-b922-18863d356278 None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:36.225825 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee743d-ac2e-4124-b922-18863d356278 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:36.226348 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee743d-ac2e-4124-b922-18863d356278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:36.243829 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-95ee743d-ac2e-4124-b922-18863d356278 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:36.245374 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-95ee743d-ac2e-4124-b922-18863d356278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:36.315759 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 226/457] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:37:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:37:36.344060 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8a6842-2577-423a-94ae-f93f0fed9ea7 None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:36.392374 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1eef28-43c2-40c3-85bf-538edd2592de None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:36.392992 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1eef28-43c2-40c3-85bf-538edd2592de None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:36.393471 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1eef28-43c2-40c3-85bf-538edd2592de None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:36.395457 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 227/458] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:37:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 20:37:36.402377 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3153a-51b2-43e7-a456-4abef6c40c0e None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:36.402938 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3153a-51b2-43e7-a456-4abef6c40c0e None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:36.403418 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3153a-51b2-43e7-a456-4abef6c40c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:36.418424 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:36.423086 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-bce3153a-51b2-43e7-a456-4abef6c40c0e None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:36.424388 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-bce3153a-51b2-43e7-a456-4abef6c40c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:36.462213 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8a6842-2577-423a-94ae-f93f0fed9ea7 None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:36.501486 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 228/459] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:37:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 20:37:36.502957 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9939e69-3ab4-4e6d-ae1b-62201511b8d3 None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:36.503202 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c7019f-5d90-4f72-bc3f-48a97ec2fc0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:36.503346 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9939e69-3ab4-4e6d-ae1b-62201511b8d3 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:36.503513 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9939e69-3ab4-4e6d-ae1b-62201511b8d3 None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:36.504471 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7019f-5d90-4f72-bc3f-48a97ec2fc0c None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:36.504769 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 229/460] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:37:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:37:36.505111 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7019f-5d90-4f72-bc3f-48a97ec2fc0c None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:36.505575 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7019f-5d90-4f72-bc3f-48a97ec2fc0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:36.508957 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:36.510023 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2724f37e-2450-43ed-a702-072e378428c9 None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:36.510348 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2724f37e-2450-43ed-a702-072e378428c9 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:36.510639 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2724f37e-2450-43ed-a702-072e378428c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:36.519313 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c7019f-5d90-4f72-bc3f-48a97ec2fc0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:36.521190 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c7019f-5d90-4f72-bc3f-48a97ec2fc0c None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:36.527911 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-2724f37e-2450-43ed-a702-072e378428c9 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:36.529103 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-2724f37e-2450-43ed-a702-072e378428c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:36.541665 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-a8c7019f-5d90-4f72-bc3f-48a97ec2fc0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:37:36.541665 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:36.541665 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:36.541665 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:36.541665 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:36.541665 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:36.541665 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:36.541665 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:36.541665 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:36.541665 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:36.541665 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:36.541665 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:36.541665 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:37:36.541665 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:37:36.541665 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:37:36.542578 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:37:36.542578 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:36.542578 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:36.542578 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:36.542578 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:36.542578 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:36.542578 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:36.542578 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:36.542578 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:36.542578 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:36.542578 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:36.542578 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:36.542578 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:36.542578 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:36.542578 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:36.542578 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:36.542578 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:36.543393 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:37:36.543393 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:37:36.543393 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:37:36.543393 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:37:36.546215 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 232/461] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jul 15 20:37:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:37:36.547498 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c7019f-5d90-4f72-bc3f-48a97ec2fc0c None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:36.602816 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 230/462] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:37:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 20:37:36.603486 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2724f37e-2450-43ed-a702-072e378428c9 None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:36.664308 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c7019f-5d90-4f72-bc3f-48a97ec2fc0c None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:36.671398 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:36.704501 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe7fb7-2d65-48f8-b94e-49f1517baf84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:36.705319 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe7fb7-2d65-48f8-b94e-49f1517baf84 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:36.705607 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe7fb7-2d65-48f8-b94e-49f1517baf84 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:36.705886 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe7fb7-2d65-48f8-b94e-49f1517baf84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:36.716753 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2724f37e-2450-43ed-a702-072e378428c9 None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:36.717182 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fe7fb7-2d65-48f8-b94e-49f1517baf84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:36.719339 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fe7fb7-2d65-48f8-b94e-49f1517baf84 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:36.738825 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-d4fe7fb7-2d65-48f8-b94e-49f1517baf84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:37:36.738825 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:36.738825 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:36.738825 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:36.738825 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:36.738825 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:36.738825 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:36.738825 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:36.738825 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:36.738825 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:36.738825 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:36.738825 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:36.738825 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:37:36.738825 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:37:36.738825 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:37:36.739670 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:37:36.739670 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:36.739670 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:36.739670 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:36.739670 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:36.739670 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:36.739670 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:36.739670 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:36.739670 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:36.739670 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:36.739670 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:36.739670 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:36.739670 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:36.739670 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:36.739670 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:36.739670 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:36.739670 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:36.740488 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:37:36.740488 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:37:36.740488 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:37:36.740488 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:37:36.740488 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 233/463] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jul 15 20:37:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:37:36.740748 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe7fb7-2d65-48f8-b94e-49f1517baf84 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:36.758920 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d551830-b41d-4a82-bb93-6239431d9991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:36.759682 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d551830-b41d-4a82-bb93-6239431d9991 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:36.759872 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d551830-b41d-4a82-bb93-6239431d9991 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:36.760155 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d551830-b41d-4a82-bb93-6239431d9991 None admin] PATH_INFO: `/v3/domains` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:36.760884 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d551830-b41d-4a82-bb93-6239431d9991 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:36.761200 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d551830-b41d-4a82-bb93-6239431d9991 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:36.762923 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d551830-b41d-4a82-bb93-6239431d9991 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:36.786431 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 231/464] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jul 15 20:37:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:36.786431 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d551830-b41d-4a82-bb93-6239431d9991 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:36.787947 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:36.855744 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe7fb7-2d65-48f8-b94e-49f1517baf84 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:36.890760 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae91b621-f9b5-4514-9934-b6426e8a3986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:36.891549 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae91b621-f9b5-4514-9934-b6426e8a3986 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:36.891836 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae91b621-f9b5-4514-9934-b6426e8a3986 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:36.892118 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae91b621-f9b5-4514-9934-b6426e8a3986 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:36.892628 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d551830-b41d-4a82-bb93-6239431d9991 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:36.901962 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae91b621-f9b5-4514-9934-b6426e8a3986 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:36.903437 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae91b621-f9b5-4514-9934-b6426e8a3986 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:36.917885 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:36.921991 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-ae91b621-f9b5-4514-9934-b6426e8a3986 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:37:36.921991 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:36.921991 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:36.921991 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:36.921991 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:36.921991 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:36.921991 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:36.921991 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:36.921991 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:36.921991 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:36.921991 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:36.921991 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:36.921991 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:37:36.921991 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:37:36.921991 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:37:36.922949 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:37:36.922949 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:36.922949 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:36.922949 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:36.922949 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:36.922949 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:36.922949 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:36.922949 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:36.922949 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:36.922949 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:36.922949 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:36.922949 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:36.922949 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:36.922949 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:36.922949 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:36.922949 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:36.922949 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:36.923786 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:37:36.923786 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:37:36.923786 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:37:36.923786 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:37:36.923786 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 234/465] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jul 15 20:37:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:37:36.924139 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae91b621-f9b5-4514-9934-b6426e8a3986 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:36.930013 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c2ce2c-13f7-4d9f-8ea5-6d124a27dfb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:36.930708 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c2ce2c-13f7-4d9f-8ea5-6d124a27dfb4 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:36.930995 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c2ce2c-13f7-4d9f-8ea5-6d124a27dfb4 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:36.931273 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c2ce2c-13f7-4d9f-8ea5-6d124a27dfb4 None admin] PATH_INFO: `/v3/domains` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:36.931993 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c2ce2c-13f7-4d9f-8ea5-6d124a27dfb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:36.932302 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c2ce2c-13f7-4d9f-8ea5-6d124a27dfb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:36.933681 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c2ce2c-13f7-4d9f-8ea5-6d124a27dfb4 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:36.945223 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 232/466] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jul 15 20:37:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:36.946454 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd93e5b-7982-4496-b140-8c1a56789a33 None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:36.946746 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd93e5b-7982-4496-b140-8c1a56789a33 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:36.947025 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd93e5b-7982-4496-b140-8c1a56789a33 None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:36.948406 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 233/467] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:37:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:37:36.949475 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd93e5b-7982-4496-b140-8c1a56789a33 None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:37.016022 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:37.025755 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae91b621-f9b5-4514-9934-b6426e8a3986 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:37.051461 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd93e5b-7982-4496-b140-8c1a56789a33 None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:37.058824 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae29a1f-ed12-4a82-9aa0-e490005f9119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:37.059496 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae29a1f-ed12-4a82-9aa0-e490005f9119 None admin] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:37.059786 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae29a1f-ed12-4a82-9aa0-e490005f9119 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:37.060071 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae29a1f-ed12-4a82-9aa0-e490005f9119 None admin] PATH_INFO: `/v3/users` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:37.060779 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae29a1f-ed12-4a82-9aa0-e490005f9119 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:37.062804 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae29a1f-ed12-4a82-9aa0-e490005f9119 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:37.082951 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 235/468] 10.222.0.16 () {60 vars in 1132 bytes} [Fri Jul 15 20:37:36 2022] POST /identity/v3/users => generated 246 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:37:37.083745 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae29a1f-ed12-4a82-9aa0-e490005f9119 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:37.088241 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7925c091-d33a-481d-8e79-a3b3ad7e4ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:37.088922 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7925c091-d33a-481d-8e79-a3b3ad7e4ceb None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:37.089209 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7925c091-d33a-481d-8e79-a3b3ad7e4ceb None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:37.089488 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7925c091-d33a-481d-8e79-a3b3ad7e4ceb None admin] PATH_INFO: `/v3/domains` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:37.090403 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7925c091-d33a-481d-8e79-a3b3ad7e4ceb None admin] RBAC: Adding query filter params (name=Default) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:37.090763 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7925c091-d33a-481d-8e79-a3b3ad7e4ceb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:37.092887 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7925c091-d33a-481d-8e79-a3b3ad7e4ceb None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:37.107845 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 234/469] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jul 15 20:37:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:37.110606 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a224fc5-94d5-4e23-bf7c-406d0cb7911f None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:37.110910 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a224fc5-94d5-4e23-bf7c-406d0cb7911f None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:37.111198 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a224fc5-94d5-4e23-bf7c-406d0cb7911f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:37.129969 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-6a224fc5-94d5-4e23-bf7c-406d0cb7911f None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:37.131257 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-6a224fc5-94d5-4e23-bf7c-406d0cb7911f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:37.178776 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:37.208391 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 235/470] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:37:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:37:37.209241 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a224fc5-94d5-4e23-bf7c-406d0cb7911f None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:37.220760 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae29a1f-ed12-4a82-9aa0-e490005f9119 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:37.261273 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bada8f7b-d4fc-48dd-884e-072bbd02b112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:37.261947 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada8f7b-d4fc-48dd-884e-072bbd02b112 None admin] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:37.262267 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada8f7b-d4fc-48dd-884e-072bbd02b112 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:37.262545 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada8f7b-d4fc-48dd-884e-072bbd02b112 None admin] PATH_INFO: `/v3/users` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:37.264310 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bada8f7b-d4fc-48dd-884e-072bbd02b112 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:37.264715 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bada8f7b-d4fc-48dd-884e-072bbd02b112 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:37.288691 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 236/471] 10.222.0.16 () {60 vars in 1132 bytes} [Fri Jul 15 20:37:37 2022] POST /identity/v3/users => generated 248 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:37:37.288977 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bada8f7b-d4fc-48dd-884e-072bbd02b112 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:37.291674 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:37.339385 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a224fc5-94d5-4e23-bf7c-406d0cb7911f None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:37.380645 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c75a7e1-8ee7-4a53-9358-dd9b381d87bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:37.381341 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c75a7e1-8ee7-4a53-9358-dd9b381d87bc None admin] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:37.381630 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c75a7e1-8ee7-4a53-9358-dd9b381d87bc None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:37.381908 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c75a7e1-8ee7-4a53-9358-dd9b381d87bc None admin] PATH_INFO: `/v3/users` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:37.382662 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c75a7e1-8ee7-4a53-9358-dd9b381d87bc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:37.384151 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c75a7e1-8ee7-4a53-9358-dd9b381d87bc None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:37.411174 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 236/472] 10.222.0.16 () {60 vars in 1132 bytes} [Fri Jul 15 20:37:37 2022] POST /identity/v3/users => generated 248 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:37:37.425126 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bada8f7b-d4fc-48dd-884e-072bbd02b112 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:37.472222 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65b0db6-8dab-48a8-b244-d2220a64d238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:37.473062 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b0db6-8dab-48a8-b244-d2220a64d238 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:37.473343 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b0db6-8dab-48a8-b244-d2220a64d238 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:37.473623 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b0db6-8dab-48a8-b244-d2220a64d238 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:37.487918 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65b0db6-8dab-48a8-b244-d2220a64d238 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:37.489425 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65b0db6-8dab-48a8-b244-d2220a64d238 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:37.509356 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-b65b0db6-8dab-48a8-b244-d2220a64d238 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:37:37.509356 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:37.509356 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:37.509356 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:37.509356 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:37.509356 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:37.509356 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:37.509356 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:37.509356 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:37.509356 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:37.509356 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:37.509356 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:37.509356 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:37:37.509356 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:37:37.509356 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:37:37.510359 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:37:37.510359 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:37.510359 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:37.510359 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:37.510359 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:37.510359 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:37.510359 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:37.510359 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:37.510359 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:37.510359 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:37.510359 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:37.510359 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:37.510359 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:37.510359 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:37.510359 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:37.510359 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:37.510359 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:37.511179 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:37:37.511179 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:37:37.511179 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:37:37.511179 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:37:37.511179 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 237/473] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jul 15 20:37:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:37:37.518550 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c75a7e1-8ee7-4a53-9358-dd9b381d87bc None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:37.556054 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:37.635233 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c75a7e1-8ee7-4a53-9358-dd9b381d87bc None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:37.675268 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dcaedd-f734-4ba4-8c14-789236164ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:37.675933 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dcaedd-f734-4ba4-8c14-789236164ba5 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:37.676219 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dcaedd-f734-4ba4-8c14-789236164ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:37.676496 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dcaedd-f734-4ba4-8c14-789236164ba5 None admin] PATH_INFO: `/v3/domains` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:37.677217 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dcaedd-f734-4ba4-8c14-789236164ba5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:37.677520 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dcaedd-f734-4ba4-8c14-789236164ba5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:37.678945 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dcaedd-f734-4ba4-8c14-789236164ba5 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:37.691511 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 237/474] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jul 15 20:37:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:37.697413 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65b0db6-8dab-48a8-b244-d2220a64d238 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:37.757657 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:37.806310 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65b0db6-8dab-48a8-b244-d2220a64d238 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:37.843572 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20e3e18-7d4d-4bc1-9cb2-198a35be100c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:37.844595 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e3e18-7d4d-4bc1-9cb2-198a35be100c None admin] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:37.845097 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e3e18-7d4d-4bc1-9cb2-198a35be100c None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:37.845600 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e3e18-7d4d-4bc1-9cb2-198a35be100c None admin] PATH_INFO: `/v3/users` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:37.846518 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20e3e18-7d4d-4bc1-9cb2-198a35be100c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:37.848136 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20e3e18-7d4d-4bc1-9cb2-198a35be100c None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:37.875777 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 238/475] 10.222.0.16 () {60 vars in 1132 bytes} [Fri Jul 15 20:37:37 2022] POST /identity/v3/users => generated 249 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 20:37:39.489474 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a024c70b-8681-4db9-b5f3-a868231b6470 None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:39.489989 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a024c70b-8681-4db9-b5f3-a868231b6470 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:39.490066 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a024c70b-8681-4db9-b5f3-a868231b6470 None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:39.491652 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 238/476] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:37:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:37:39.496985 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2512e6ef-9cd7-421c-bfa3-a05d290e9c1f None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:39.497377 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2512e6ef-9cd7-421c-bfa3-a05d290e9c1f None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:39.497556 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2512e6ef-9cd7-421c-bfa3-a05d290e9c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:39.514676 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-2512e6ef-9cd7-421c-bfa3-a05d290e9c1f None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:39.516825 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-2512e6ef-9cd7-421c-bfa3-a05d290e9c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:39.586733 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 239/477] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:37:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:37:39.612018 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a024c70b-8681-4db9-b5f3-a868231b6470 None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:39.721968 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:39.732524 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a024c70b-8681-4db9-b5f3-a868231b6470 None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:39.769558 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa1b07e-7308-4959-b548-5991a85dcb9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:39.770392 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1b07e-7308-4959-b548-5991a85dcb9c None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:39.770684 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1b07e-7308-4959-b548-5991a85dcb9c None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:39.770967 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1b07e-7308-4959-b548-5991a85dcb9c None admin] PATH_INFO: `/v3/roles/service` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:39.782596 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa1b07e-7308-4959-b548-5991a85dcb9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:37:39.788764 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c460cb95-cc81-4b47-94f0-ab0768676de8 None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:39.791932 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c460cb95-cc81-4b47-94f0-ab0768676de8 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:39.791932 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c460cb95-cc81-4b47-94f0-ab0768676de8 None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:39.791932 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 240/478] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:37:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:37:39.793205 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-6aa1b07e-7308-4959-b548-5991a85dcb9c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 20:37:39.793205 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:39.793205 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:39.793205 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:39.793205 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:39.793205 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:39.793205 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:39.793205 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:39.793205 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:39.793205 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:39.793205 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:39.793205 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:39.793205 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:37:39.793205 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:37:39.793205 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:37:39.793205 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:37:39.794141 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:37:39.794141 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:37:39.794141 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:37:39.794141 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:37:39.794141 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:39.794141 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:39.794141 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:39.794141 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:39.794141 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:39.794141 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:39.794141 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:39.794141 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:39.794141 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:39.794141 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:39.794141 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:39.794141 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:39.794908 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:39.794908 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:39.794908 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:39.794908 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:39.794908 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:37:39.794908 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:37:39.794908 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:37:39.794908 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:37:39.794908 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:37:39.794908 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:37:39.794908 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 20:37:39.794908 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:37:39.795978 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd6c132-02be-4061-aead-ccf31f54b149 None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:39.797442 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd6c132-02be-4061-aead-ccf31f54b149 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:39.797442 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd6c132-02be-4061-aead-ccf31f54b149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:39.798001 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 239/479] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Jul 15 20:37:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:37:39.803518 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa1b07e-7308-4959-b548-5991a85dcb9c None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:39.816376 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-8fd6c132-02be-4061-aead-ccf31f54b149 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:39.817566 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-8fd6c132-02be-4061-aead-ccf31f54b149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:39.855108 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:39.891647 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 241/480] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:37:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 20:37:39.898847 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad490487-60ec-4e8a-a894-8c26243b630c None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:39.898847 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad490487-60ec-4e8a-a894-8c26243b630c None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:39.898847 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad490487-60ec-4e8a-a894-8c26243b630c None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:39.898847 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 242/481] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:37:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:37:39.900656 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe1ff55-7935-4bf2-8773-2dcb4d4c0484 None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:39.900951 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe1ff55-7935-4bf2-8773-2dcb4d4c0484 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:39.901234 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe1ff55-7935-4bf2-8773-2dcb4d4c0484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:39.918821 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-ffe1ff55-7935-4bf2-8773-2dcb4d4c0484 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:39.920015 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-ffe1ff55-7935-4bf2-8773-2dcb4d4c0484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:39.920117 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa1b07e-7308-4959-b548-5991a85dcb9c None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:39.961346 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d0a4b7-418e-44dc-9cb9-26bc3989b7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:39.962007 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0a4b7-418e-44dc-9cb9-26bc3989b7bc None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:39.962319 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0a4b7-418e-44dc-9cb9-26bc3989b7bc None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:39.962585 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0a4b7-418e-44dc-9cb9-26bc3989b7bc None admin] PATH_INFO: `/v3/roles` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:39.963334 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d0a4b7-418e-44dc-9cb9-26bc3989b7bc None admin] RBAC: Adding query filter params (name=service) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:39.963641 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d0a4b7-418e-44dc-9cb9-26bc3989b7bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:39.965007 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d0a4b7-418e-44dc-9cb9-26bc3989b7bc None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:39.973937 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 240/482] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Jul 15 20:37:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:39.974770 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d0a4b7-418e-44dc-9cb9-26bc3989b7bc None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:39.991201 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:40.010259 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 243/483] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:37:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 20:37:40.010259 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe1ff55-7935-4bf2-8773-2dcb4d4c0484 None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:40.096200 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d0a4b7-418e-44dc-9cb9-26bc3989b7bc None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:40.131858 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:40.135691 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe1ff55-7935-4bf2-8773-2dcb4d4c0484 None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:40.141949 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249cff99-12b3-42a5-8015-367652a01895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:40.142786 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249cff99-12b3-42a5-8015-367652a01895 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:40.143072 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249cff99-12b3-42a5-8015-367652a01895 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:40.143348 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249cff99-12b3-42a5-8015-367652a01895 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:40.154257 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249cff99-12b3-42a5-8015-367652a01895 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:37:40.163576 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-249cff99-12b3-42a5-8015-367652a01895 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 20:37:40.163576 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:40.163576 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:40.163576 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:40.163576 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:40.163576 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:40.163576 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:40.163576 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:40.163576 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:40.163576 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:40.163576 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:40.163576 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:40.163576 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:37:40.163576 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:37:40.163576 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:37:40.163576 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:37:40.164679 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:37:40.164679 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:37:40.164679 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:37:40.164679 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:37:40.164679 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:40.164679 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:40.164679 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:40.164679 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:40.164679 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:40.164679 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:40.164679 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:40.164679 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:40.164679 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:40.164679 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:40.164679 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:40.164679 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:40.165476 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:40.165476 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:40.165476 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:40.165476 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:40.165476 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:37:40.165476 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:37:40.165476 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:37:40.165476 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:37:40.165476 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:37:40.165476 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:37:40.165476 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 20:37:40.165476 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:37:40.165476 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 241/484] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Jul 15 20:37:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:37:40.166742 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249cff99-12b3-42a5-8015-367652a01895 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:40.181584 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69187bfd-429d-4461-bc5e-137d0d46b4bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:40.182737 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69187bfd-429d-4461-bc5e-137d0d46b4bc None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:40.182843 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69187bfd-429d-4461-bc5e-137d0d46b4bc None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:40.183067 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69187bfd-429d-4461-bc5e-137d0d46b4bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:40.194863 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69187bfd-429d-4461-bc5e-137d0d46b4bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:40.196508 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69187bfd-429d-4461-bc5e-137d0d46b4bc None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:40.215409 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-69187bfd-429d-4461-bc5e-137d0d46b4bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:37:40.215409 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:40.215409 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:40.215409 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:40.215409 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:40.215409 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:40.215409 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:40.215409 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:40.215409 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:40.215409 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:40.215409 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:40.215409 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:40.215409 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:37:40.215409 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:37:40.215409 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:37:40.216477 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:37:40.216477 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:40.216477 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:40.216477 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:40.216477 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:40.216477 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:40.216477 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:40.216477 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:40.216477 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:40.216477 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:40.216477 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:40.216477 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:40.216477 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:40.216477 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:40.216477 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:40.216477 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:40.216477 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:40.218029 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:37:40.218029 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:37:40.218029 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:37:40.218029 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:37:40.218029 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 244/485] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jul 15 20:37:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:37:40.218029 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69187bfd-429d-4461-bc5e-137d0d46b4bc None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:40.250739 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:40.277448 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249cff99-12b3-42a5-8015-367652a01895 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:40.310661 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b81f40d-9235-4954-b3c1-8d5595e28226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:40.311474 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b81f40d-9235-4954-b3c1-8d5595e28226 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:40.311761 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b81f40d-9235-4954-b3c1-8d5595e28226 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:40.312037 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b81f40d-9235-4954-b3c1-8d5595e28226 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:40.315132 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69187bfd-429d-4461-bc5e-137d0d46b4bc None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:40.322528 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b81f40d-9235-4954-b3c1-8d5595e28226 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:37:40.330348 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-4b81f40d-9235-4954-b3c1-8d5595e28226 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 20:37:40.330348 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:40.330348 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:40.330348 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:40.330348 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:40.330348 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:40.330348 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:40.330348 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:40.330348 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:40.330348 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:40.330348 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:40.330348 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:40.330348 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:37:40.330348 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:37:40.330348 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:37:40.330348 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:37:40.331278 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:37:40.331278 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:37:40.331278 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:37:40.331278 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:37:40.331278 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:40.331278 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:40.331278 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:40.331278 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:40.331278 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:40.331278 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:40.331278 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:40.331278 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:40.331278 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:40.331278 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:40.331278 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:40.331278 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:40.332048 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:40.332048 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:40.332048 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:40.332048 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:40.332048 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:37:40.332048 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:37:40.332048 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:37:40.332048 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:37:40.332048 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:37:40.332048 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:37:40.332048 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 20:37:40.332048 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:37:40.332048 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 242/486] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Jul 15 20:37:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:37:40.332832 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c923a3b-9cc3-4e1e-a1da-23259d82a012 None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:40.333072 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c923a3b-9cc3-4e1e-a1da-23259d82a012 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:40.333344 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c923a3b-9cc3-4e1e-a1da-23259d82a012 None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:40.334607 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 243/487] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:37:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:37:40.335297 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c923a3b-9cc3-4e1e-a1da-23259d82a012 None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:40.355367 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341a7c69-199b-4879-b372-8a5a2039e525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:40.356033 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a7c69-199b-4879-b372-8a5a2039e525 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:40.356321 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a7c69-199b-4879-b372-8a5a2039e525 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:40.356599 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a7c69-199b-4879-b372-8a5a2039e525 None admin] PATH_INFO: `/v3/roles` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:40.357650 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341a7c69-199b-4879-b372-8a5a2039e525 None admin] RBAC: Adding query filter params (name=service) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:40.357650 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341a7c69-199b-4879-b372-8a5a2039e525 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:40.359689 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341a7c69-199b-4879-b372-8a5a2039e525 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:40.367513 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 245/488] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Jul 15 20:37:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:40.368293 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341a7c69-199b-4879-b372-8a5a2039e525 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:40.383446 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:40.440310 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c923a3b-9cc3-4e1e-a1da-23259d82a012 None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:40.472466 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341a7c69-199b-4879-b372-8a5a2039e525 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:40.476845 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f881b0-4812-49de-8e5a-0808d97988cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:40.477926 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f881b0-4812-49de-8e5a-0808d97988cc None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:40.477926 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f881b0-4812-49de-8e5a-0808d97988cc None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:40.478338 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f881b0-4812-49de-8e5a-0808d97988cc None admin] PATH_INFO: `/v3/domains` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:40.479101 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f881b0-4812-49de-8e5a-0808d97988cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:40.479417 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f881b0-4812-49de-8e5a-0808d97988cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:40.480817 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f881b0-4812-49de-8e5a-0808d97988cc None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:40.482502 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:40.493470 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 244/489] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jul 15 20:37:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:40.494821 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e36ad-bc81-44dd-8b25-82f5f0f7660c None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:40.495118 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e36ad-bc81-44dd-8b25-82f5f0f7660c None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:40.495400 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e36ad-bc81-44dd-8b25-82f5f0f7660c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:40.511834 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-cf6e36ad-bc81-44dd-8b25-82f5f0f7660c None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:40.512638 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e545fa9-9bef-4e0b-bb23-09e24dfd00b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:40.513063 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-cf6e36ad-bc81-44dd-8b25-82f5f0f7660c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:40.513307 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e545fa9-9bef-4e0b-bb23-09e24dfd00b9 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:40.513595 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e545fa9-9bef-4e0b-bb23-09e24dfd00b9 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:40.513876 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e545fa9-9bef-4e0b-bb23-09e24dfd00b9 None admin] PATH_INFO: `/v3/roles` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:40.515183 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e545fa9-9bef-4e0b-bb23-09e24dfd00b9 None admin] RBAC: Adding query filter params (name=service) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:40.515496 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e545fa9-9bef-4e0b-bb23-09e24dfd00b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:40.516856 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e545fa9-9bef-4e0b-bb23-09e24dfd00b9 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:40.525159 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 246/490] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Jul 15 20:37:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:40.525961 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e545fa9-9bef-4e0b-bb23-09e24dfd00b9 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:40.579033 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 245/491] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:37:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:37:40.579779 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6e36ad-bc81-44dd-8b25-82f5f0f7660c None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:40.606905 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:40.630696 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e545fa9-9bef-4e0b-bb23-09e24dfd00b9 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:40.664389 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85138523-ad1b-4d68-a989-c9611ecf8ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:40.665176 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85138523-ad1b-4d68-a989-c9611ecf8ad5 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:40.665468 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85138523-ad1b-4d68-a989-c9611ecf8ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:40.666187 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85138523-ad1b-4d68-a989-c9611ecf8ad5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:40.676827 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85138523-ad1b-4d68-a989-c9611ecf8ad5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:40.678312 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85138523-ad1b-4d68-a989-c9611ecf8ad5 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:40.678540 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6e36ad-bc81-44dd-8b25-82f5f0f7660c None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:40.696221 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-85138523-ad1b-4d68-a989-c9611ecf8ad5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:37:40.696221 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:40.696221 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:40.696221 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:40.696221 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:40.696221 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:40.696221 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:40.696221 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:40.696221 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:40.696221 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:40.696221 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:40.696221 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:40.696221 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:37:40.696221 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:37:40.696221 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:37:40.697240 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:37:40.697240 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:40.697240 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:40.697240 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:40.697240 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:40.697240 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:40.697240 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:40.697240 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:40.697240 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:40.697240 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:40.697240 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:40.697240 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:40.697240 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:40.697240 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:40.697240 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:40.697240 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:40.697240 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:40.698112 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:37:40.698112 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:37:40.698112 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:37:40.698112 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:37:40.698112 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 247/492] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jul 15 20:37:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:37:40.698396 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85138523-ad1b-4d68-a989-c9611ecf8ad5 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:40.703796 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:40.715947 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8457390c-c185-467e-ad2c-d17781a333a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:40.716731 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8457390c-c185-467e-ad2c-d17781a333a3 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:40.717020 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8457390c-c185-467e-ad2c-d17781a333a3 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:40.717299 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8457390c-c185-467e-ad2c-d17781a333a3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:40.724996 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8457390c-c185-467e-ad2c-d17781a333a3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:40.726450 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8457390c-c185-467e-ad2c-d17781a333a3 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:40.743838 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-8457390c-c185-467e-ad2c-d17781a333a3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 15 20:37:40.743838 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:40.743838 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:40.743838 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:40.743838 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:40.743838 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:40.743838 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:40.743838 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:40.743838 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:40.743838 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:40.743838 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:40.743838 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:40.743838 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 20:37:40.743838 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 20:37:40.743838 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 20:37:40.743838 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 20:37:40.744883 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:40.744883 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:40.744883 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 20:37:40.744883 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:37:40.744883 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 20:37:40.744883 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:37:40.744883 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:40.744883 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:40.744883 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:40.744883 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:40.744883 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:40.744883 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:40.744883 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:40.744883 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:40.744883 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:40.744883 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:40.744883 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:40.744883 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:40.745940 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:40.745940 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:40.745940 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 20:37:40.745940 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 20:37:40.745940 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 20:37:40.745940 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 20:37:40.745940 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 20:37:40.745940 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 20:37:40.745940 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 15 20:37:40.745940 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:37:40.745940 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 246/493] 10.222.0.16 () {56 vars in 1093 bytes} [Fri Jul 15 20:37:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:37:40.745940 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8457390c-c185-467e-ad2c-d17781a333a3 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:40.798111 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85138523-ad1b-4d68-a989-c9611ecf8ad5 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:40.824029 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:40.832445 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d062aed-2485-434f-b283-a6de625dc7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:40.833238 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d062aed-2485-434f-b283-a6de625dc7fc None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:40.833525 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d062aed-2485-434f-b283-a6de625dc7fc None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:40.833807 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d062aed-2485-434f-b283-a6de625dc7fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:40.844252 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d062aed-2485-434f-b283-a6de625dc7fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:40.845504 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8457390c-c185-467e-ad2c-d17781a333a3 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:40.845716 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d062aed-2485-434f-b283-a6de625dc7fc None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:40.862559 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-5d062aed-2485-434f-b283-a6de625dc7fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:37:40.862559 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:40.862559 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:40.862559 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:40.862559 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:40.862559 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:40.862559 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:40.862559 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:40.862559 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:40.862559 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:40.862559 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:40.862559 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:40.862559 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:37:40.862559 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:37:40.862559 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:37:40.863482 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:37:40.863482 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:40.863482 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:40.863482 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:40.863482 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:40.863482 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:40.863482 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:40.863482 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:40.863482 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:40.863482 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:40.863482 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:40.863482 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:40.863482 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:40.863482 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:40.863482 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:40.863482 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:40.863482 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:40.864294 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:37:40.864294 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:37:40.864294 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:37:40.864294 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:37:40.864294 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 248/494] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jul 15 20:37:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:37:40.864555 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d062aed-2485-434f-b283-a6de625dc7fc None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:40.882121 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406991fb-7b6b-41d2-8cf7-793632afe7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:40.882913 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406991fb-7b6b-41d2-8cf7-793632afe7f8 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:40.883203 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406991fb-7b6b-41d2-8cf7-793632afe7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:40.883486 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406991fb-7b6b-41d2-8cf7-793632afe7f8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:40.894066 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406991fb-7b6b-41d2-8cf7-793632afe7f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:37:40.901762 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-406991fb-7b6b-41d2-8cf7-793632afe7f8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 20:37:40.901762 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:40.901762 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:40.901762 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:40.901762 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:40.901762 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:40.901762 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:40.901762 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:40.901762 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:40.901762 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:40.901762 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:40.901762 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:40.901762 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:37:40.901762 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:37:40.901762 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:37:40.901762 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:37:40.902660 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:37:40.902660 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:37:40.902660 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:37:40.902660 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:37:40.902660 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:40.902660 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:40.902660 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:40.902660 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:40.902660 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:40.902660 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:40.902660 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:40.902660 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:40.902660 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:40.902660 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:40.902660 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:40.902660 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:40.903456 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:40.903456 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:40.903456 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:40.903456 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:40.903456 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:37:40.903456 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:37:40.903456 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:37:40.903456 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:37:40.903456 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:37:40.903456 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:37:40.903456 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 20:37:40.903456 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:37:40.903456 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 247/495] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Jul 15 20:37:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:37:40.904104 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406991fb-7b6b-41d2-8cf7-793632afe7f8 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:40.954263 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:40.970507 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d062aed-2485-434f-b283-a6de625dc7fc None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:41.004057 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c6bad-be67-4ce6-915a-fec289ce0b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:41.004715 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c6bad-be67-4ce6-915a-fec289ce0b6d None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:41.005005 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c6bad-be67-4ce6-915a-fec289ce0b6d None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:41.005283 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c6bad-be67-4ce6-915a-fec289ce0b6d None admin] PATH_INFO: `/v3/domains` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:41.005994 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6c6bad-be67-4ce6-915a-fec289ce0b6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:41.006329 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6c6bad-be67-4ce6-915a-fec289ce0b6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:41.007705 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6c6bad-be67-4ce6-915a-fec289ce0b6d None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:41.008645 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406991fb-7b6b-41d2-8cf7-793632afe7f8 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:41.020786 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 249/496] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jul 15 20:37:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:41.021575 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c6bad-be67-4ce6-915a-fec289ce0b6d None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:41.043551 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb6b591-582b-4581-98ba-7ec5b2b11b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:41.044390 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6b591-582b-4581-98ba-7ec5b2b11b20 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:41.044673 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6b591-582b-4581-98ba-7ec5b2b11b20 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:41.044954 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6b591-582b-4581-98ba-7ec5b2b11b20 None admin] PATH_INFO: `/v3/users` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:41.045784 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb6b591-582b-4581-98ba-7ec5b2b11b20 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:41.046111 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb6b591-582b-4581-98ba-7ec5b2b11b20 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:41.047551 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb6b591-582b-4581-98ba-7ec5b2b11b20 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:41.062593 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:41.084793 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 248/497] 10.222.0.16 () {56 vars in 1133 bytes} [Fri Jul 15 20:37:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:41.085668 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb6b591-582b-4581-98ba-7ec5b2b11b20 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:41.125414 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c6bad-be67-4ce6-915a-fec289ce0b6d None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:41.158152 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00306db8-5eeb-4980-937d-3cb05edad40b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:41.158810 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00306db8-5eeb-4980-937d-3cb05edad40b None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:41.159088 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00306db8-5eeb-4980-937d-3cb05edad40b None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:41.159360 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00306db8-5eeb-4980-937d-3cb05edad40b None admin] PATH_INFO: `/v3/domains` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:41.160071 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00306db8-5eeb-4980-937d-3cb05edad40b None admin] RBAC: Adding query filter params (name=Default) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:41.160373 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00306db8-5eeb-4980-937d-3cb05edad40b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:41.161730 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00306db8-5eeb-4980-937d-3cb05edad40b None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:41.175088 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 250/498] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jul 15 20:37:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:41.175905 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00306db8-5eeb-4980-937d-3cb05edad40b None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:41.188621 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb6b591-582b-4581-98ba-7ec5b2b11b20 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:41.190202 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:41.225164 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567dbaa0-2959-4f9a-bc46-cbbba3d8a36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:41.225818 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567dbaa0-2959-4f9a-bc46-cbbba3d8a36d None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:41.226118 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567dbaa0-2959-4f9a-bc46-cbbba3d8a36d None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:41.226401 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567dbaa0-2959-4f9a-bc46-cbbba3d8a36d None admin] PATH_INFO: `/v3/roles` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:41.227141 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567dbaa0-2959-4f9a-bc46-cbbba3d8a36d None admin] RBAC: Adding query filter params (name=service) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:41.227448 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567dbaa0-2959-4f9a-bc46-cbbba3d8a36d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:41.228820 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567dbaa0-2959-4f9a-bc46-cbbba3d8a36d None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:41.240851 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 249/499] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Jul 15 20:37:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:41.240851 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567dbaa0-2959-4f9a-bc46-cbbba3d8a36d None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:41.273450 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:41.276555 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00306db8-5eeb-4980-937d-3cb05edad40b None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:41.310021 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e72e8e1-6802-47ff-a56b-c56abda58efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:41.310842 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72e8e1-6802-47ff-a56b-c56abda58efe None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:41.311133 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72e8e1-6802-47ff-a56b-c56abda58efe None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:41.311606 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72e8e1-6802-47ff-a56b-c56abda58efe None admin] PATH_INFO: `/v3/users/glance` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:41.319009 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e72e8e1-6802-47ff-a56b-c56abda58efe None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:41.320658 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e72e8e1-6802-47ff-a56b-c56abda58efe None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:41.336187 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567dbaa0-2959-4f9a-bc46-cbbba3d8a36d None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:41.336317 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-7e72e8e1-6802-47ff-a56b-c56abda58efe None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 15 20:37:41.336317 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:41.336317 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:41.336317 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:41.336317 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:41.336317 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:41.336317 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:41.336317 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:41.336317 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:41.336317 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:41.336317 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:41.336317 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:41.336317 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 20:37:41.336317 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 20:37:41.336317 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 20:37:41.336317 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 20:37:41.337317 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:41.337317 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:41.337317 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 20:37:41.337317 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:37:41.337317 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 20:37:41.337317 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:37:41.337317 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:41.337317 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:41.337317 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:41.337317 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:41.337317 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:41.337317 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:41.337317 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:41.337317 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:41.337317 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:41.337317 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:41.337317 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:41.337317 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:41.338406 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:41.338406 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:41.338406 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 20:37:41.338406 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 20:37:41.338406 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 20:37:41.338406 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 20:37:41.338406 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 20:37:41.338406 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 20:37:41.338406 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 15 20:37:41.338406 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:37:41.338406 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 251/500] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jul 15 20:37:41 2022] GET /identity/v3/users/glance => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:37:41.339070 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e72e8e1-6802-47ff-a56b-c56abda58efe None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:41.373067 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ae228b-e5dd-4baa-a1a7-7d4cdf95f0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:41.373728 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae228b-e5dd-4baa-a1a7-7d4cdf95f0d7 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:41.374010 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae228b-e5dd-4baa-a1a7-7d4cdf95f0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:41.374317 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae228b-e5dd-4baa-a1a7-7d4cdf95f0d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:41.403936 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:41.438056 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e72e8e1-6802-47ff-a56b-c56abda58efe None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:41.440077 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ae228b-e5dd-4baa-a1a7-7d4cdf95f0d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:41.441537 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ae228b-e5dd-4baa-a1a7-7d4cdf95f0d7 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:41.478469 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a6ecfc-0f2f-400a-8777-0c55557e7af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:41.479272 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a6ecfc-0f2f-400a-8777-0c55557e7af7 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:41.479562 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a6ecfc-0f2f-400a-8777-0c55557e7af7 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:41.479846 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a6ecfc-0f2f-400a-8777-0c55557e7af7 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:41.487537 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a6ecfc-0f2f-400a-8777-0c55557e7af7 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:41.489000 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a6ecfc-0f2f-400a-8777-0c55557e7af7 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:41.503667 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-c4a6ecfc-0f2f-400a-8777-0c55557e7af7 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 15 20:37:41.503667 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:41.503667 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:41.503667 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:41.503667 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:41.503667 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:41.503667 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:41.503667 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:41.503667 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:41.503667 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:41.503667 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:41.503667 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:41.503667 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 20:37:41.503667 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 20:37:41.503667 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 20:37:41.503667 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 20:37:41.504732 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:41.504732 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:41.504732 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 20:37:41.504732 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:37:41.504732 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 20:37:41.504732 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:37:41.504732 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:41.504732 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:41.504732 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:41.504732 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:41.504732 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:41.504732 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:41.504732 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:41.504732 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:41.504732 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:41.504732 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:41.504732 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:41.504732 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:41.505738 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:41.505738 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:41.505738 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 20:37:41.505738 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 20:37:41.505738 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 20:37:41.505738 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 20:37:41.505738 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 20:37:41.505738 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 20:37:41.505738 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 15 20:37:41.505738 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:37:41.505738 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 252/501] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jul 15 20:37:41 2022] GET /identity/v3/users/cinder => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:37:41.505738 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a6ecfc-0f2f-400a-8777-0c55557e7af7 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:41.527460 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:41.545914 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 250/502] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jul 15 20:37:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:41.546787 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ae228b-e5dd-4baa-a1a7-7d4cdf95f0d7 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:41.606696 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a6ecfc-0f2f-400a-8777-0c55557e7af7 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:41.607506 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:41.640841 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55df893a-b75b-4737-9d79-6839444d9f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:41.641631 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55df893a-b75b-4737-9d79-6839444d9f8a None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:41.641912 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55df893a-b75b-4737-9d79-6839444d9f8a None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:41.642225 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55df893a-b75b-4737-9d79-6839444d9f8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:41.646421 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ae228b-e5dd-4baa-a1a7-7d4cdf95f0d7 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:41.652592 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55df893a-b75b-4737-9d79-6839444d9f8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:41.654051 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55df893a-b75b-4737-9d79-6839444d9f8a None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:41.670751 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-55df893a-b75b-4737-9d79-6839444d9f8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:37:41.670751 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:41.670751 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:41.670751 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:41.670751 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:41.670751 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:41.670751 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:41.670751 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:41.670751 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:41.670751 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:41.670751 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:41.670751 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:41.670751 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:37:41.670751 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:37:41.670751 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:37:41.671772 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:37:41.671772 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:41.671772 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:41.671772 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:41.671772 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:41.671772 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:41.671772 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:41.671772 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:41.671772 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:41.671772 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:41.671772 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:41.671772 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:41.671772 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:41.671772 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:41.671772 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:41.671772 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:41.671772 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:41.672642 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:37:41.672642 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:37:41.672642 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:37:41.672642 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:37:41.672642 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 253/503] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jul 15 20:37:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:37:41.672903 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55df893a-b75b-4737-9d79-6839444d9f8a None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:41.681284 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3004402-39b1-4bea-bbbf-951fb5eea692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:41.681938 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3004402-39b1-4bea-bbbf-951fb5eea692 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:41.682253 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3004402-39b1-4bea-bbbf-951fb5eea692 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:41.682537 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3004402-39b1-4bea-bbbf-951fb5eea692 None admin] PATH_INFO: `/v3/users` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:41.683357 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3004402-39b1-4bea-bbbf-951fb5eea692 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:41.683661 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3004402-39b1-4bea-bbbf-951fb5eea692 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:41.685094 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3004402-39b1-4bea-bbbf-951fb5eea692 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:41.703191 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 251/504] 10.222.0.16 () {56 vars in 1137 bytes} [Fri Jul 15 20:37:41 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:41.703980 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3004402-39b1-4bea-bbbf-951fb5eea692 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:41.747718 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:41.778216 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55df893a-b75b-4737-9d79-6839444d9f8a None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:41.801889 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3004402-39b1-4bea-bbbf-951fb5eea692 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:41.811719 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a13552-b31a-4e9d-9011-34caa72f8f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:41.812397 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a13552-b31a-4e9d-9011-34caa72f8f68 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:41.812686 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a13552-b31a-4e9d-9011-34caa72f8f68 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:41.812967 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a13552-b31a-4e9d-9011-34caa72f8f68 None admin] PATH_INFO: `/v3/users` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:41.813802 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a13552-b31a-4e9d-9011-34caa72f8f68 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:41.814136 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a13552-b31a-4e9d-9011-34caa72f8f68 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:41.815607 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a13552-b31a-4e9d-9011-34caa72f8f68 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:41.825204 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:41.837436 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf5ac65-1368-4feb-8e34-74c3e90d4018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:41.838254 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf5ac65-1368-4feb-8e34-74c3e90d4018 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:41.838541 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf5ac65-1368-4feb-8e34-74c3e90d4018 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:41.838816 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf5ac65-1368-4feb-8e34-74c3e90d4018 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:41.848753 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf5ac65-1368-4feb-8e34-74c3e90d4018 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:41.850228 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf5ac65-1368-4feb-8e34-74c3e90d4018 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:41.852340 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 254/505] 10.222.0.16 () {56 vars in 1137 bytes} [Fri Jul 15 20:37:41 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:41.852989 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a13552-b31a-4e9d-9011-34caa72f8f68 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:41.868202 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-2cf5ac65-1368-4feb-8e34-74c3e90d4018 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:37:41.868202 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:41.868202 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:41.868202 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:41.868202 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:41.868202 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:41.868202 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:41.868202 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:41.868202 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:41.868202 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:41.868202 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:41.868202 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:41.868202 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:37:41.868202 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:37:41.868202 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:37:41.869131 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:37:41.869131 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:41.869131 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:41.869131 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:41.869131 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:41.869131 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:41.869131 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:41.869131 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:41.869131 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:41.869131 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:41.869131 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:41.869131 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:41.869131 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:41.869131 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:41.869131 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:41.869131 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:41.869131 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:41.869956 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:37:41.869956 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:37:41.869956 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:37:41.869956 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:37:41.869956 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 252/506] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jul 15 20:37:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:37:41.870492 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf5ac65-1368-4feb-8e34-74c3e90d4018 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:41.959863 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a13552-b31a-4e9d-9011-34caa72f8f68 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:41.969762 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf5ac65-1368-4feb-8e34-74c3e90d4018 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:41.988466 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:41.994471 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c32f81-7cce-4e08-ba19-2c2c171fd05f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:41.995131 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c32f81-7cce-4e08-ba19-2c2c171fd05f None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:41.995414 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c32f81-7cce-4e08-ba19-2c2c171fd05f None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:41.995696 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c32f81-7cce-4e08-ba19-2c2c171fd05f None admin] PATH_INFO: `/v3/domains` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:41.996411 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c32f81-7cce-4e08-ba19-2c2c171fd05f None admin] RBAC: Adding query filter params (name=Default) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:41.996719 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c32f81-7cce-4e08-ba19-2c2c171fd05f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:41.998115 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c32f81-7cce-4e08-ba19-2c2c171fd05f None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:42.004195 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4545f1-67d0-47f1-b963-53a5e05679e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:42.004839 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4545f1-67d0-47f1-b963-53a5e05679e0 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:42.005152 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4545f1-67d0-47f1-b963-53a5e05679e0 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:42.005434 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4545f1-67d0-47f1-b963-53a5e05679e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:42.009912 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 255/507] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jul 15 20:37:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:42.010795 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c32f81-7cce-4e08-ba19-2c2c171fd05f None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:42.047465 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:42.073912 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4545f1-67d0-47f1-b963-53a5e05679e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:42.075457 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4545f1-67d0-47f1-b963-53a5e05679e0 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:42.111101 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c32f81-7cce-4e08-ba19-2c2c171fd05f None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:42.147711 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f859eed7-caca-4ac4-907a-fd61425a77d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:42.148275 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f859eed7-caca-4ac4-907a-fd61425a77d5 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:42.148587 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f859eed7-caca-4ac4-907a-fd61425a77d5 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:42.148841 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f859eed7-caca-4ac4-907a-fd61425a77d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:42.179454 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 253/508] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jul 15 20:37:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:42.180297 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4545f1-67d0-47f1-b963-53a5e05679e0 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:42.211519 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:42.221509 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f859eed7-caca-4ac4-907a-fd61425a77d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:42.223033 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f859eed7-caca-4ac4-907a-fd61425a77d5 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:42.255073 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:42.279209 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4545f1-67d0-47f1-b963-53a5e05679e0 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:42.312687 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dce626b-2045-4053-a877-492cbd86bbbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:42.313341 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce626b-2045-4053-a877-492cbd86bbbb None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:42.313630 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce626b-2045-4053-a877-492cbd86bbbb None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:42.313912 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce626b-2045-4053-a877-492cbd86bbbb None admin] PATH_INFO: `/v3/domains` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:42.314676 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dce626b-2045-4053-a877-492cbd86bbbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:42.314984 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dce626b-2045-4053-a877-492cbd86bbbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:42.316408 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dce626b-2045-4053-a877-492cbd86bbbb None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:42.322361 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 256/509] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jul 15 20:37:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:42.323194 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f859eed7-caca-4ac4-907a-fd61425a77d5 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:42.336686 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 254/510] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jul 15 20:37:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:42.336686 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dce626b-2045-4053-a877-492cbd86bbbb None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:42.413150 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:42.423441 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f859eed7-caca-4ac4-907a-fd61425a77d5 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:42.431265 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dce626b-2045-4053-a877-492cbd86bbbb None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:42.456850 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5ae6e1-c1fd-4ed5-8252-8022fd73b128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:42.457639 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ae6e1-c1fd-4ed5-8252-8022fd73b128 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:42.457926 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ae6e1-c1fd-4ed5-8252-8022fd73b128 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:42.458298 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ae6e1-c1fd-4ed5-8252-8022fd73b128 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:42.465254 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f759e6c-0de5-4d64-8eed-9ccf117d9886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:42.465451 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5ae6e1-c1fd-4ed5-8252-8022fd73b128 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:42.466034 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f759e6c-0de5-4d64-8eed-9ccf117d9886 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:42.466348 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f759e6c-0de5-4d64-8eed-9ccf117d9886 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:42.466625 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f759e6c-0de5-4d64-8eed-9ccf117d9886 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:42.466930 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5ae6e1-c1fd-4ed5-8252-8022fd73b128 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:42.469266 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:42.479366 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f759e6c-0de5-4d64-8eed-9ccf117d9886 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:42.480819 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f759e6c-0de5-4d64-8eed-9ccf117d9886 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:42.483752 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-3b5ae6e1-c1fd-4ed5-8252-8022fd73b128 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 15 20:37:42.483752 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:42.483752 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:42.483752 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:42.483752 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:42.483752 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:42.483752 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:42.483752 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:42.483752 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:42.483752 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:42.483752 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:42.483752 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:42.483752 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 20:37:42.483752 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 20:37:42.483752 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 20:37:42.483752 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 20:37:42.484748 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:42.484748 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:42.484748 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 20:37:42.484748 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:37:42.484748 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 20:37:42.484748 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:37:42.484748 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:42.484748 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:42.484748 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:42.484748 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:42.484748 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:42.484748 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:42.484748 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:42.484748 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:42.484748 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:42.484748 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:42.484748 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:42.484748 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:42.485728 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:42.485728 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:42.485728 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 20:37:42.485728 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 20:37:42.485728 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 20:37:42.485728 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 20:37:42.485728 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 20:37:42.485728 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 20:37:42.485728 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 15 20:37:42.485728 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:37:42.485728 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 257/511] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Jul 15 20:37:42 2022] GET /identity/v3/users/neutron => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:37:42.485728 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5ae6e1-c1fd-4ed5-8252-8022fd73b128 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:42.502854 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-8f759e6c-0de5-4d64-8eed-9ccf117d9886 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:37:42.502854 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:42.502854 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:42.502854 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:42.502854 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:42.502854 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:42.502854 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:42.502854 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:42.502854 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:42.502854 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:42.502854 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:42.502854 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:42.502854 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:37:42.502854 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:37:42.502854 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:37:42.504414 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:37:42.504414 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:42.504414 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:42.504414 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:42.504414 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:42.504414 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:42.504414 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:42.504414 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:42.504414 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:42.504414 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:42.504414 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:42.504414 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:42.504414 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:42.504414 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:42.504414 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:42.504414 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:42.504414 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:42.505447 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:37:42.505447 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:37:42.505447 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:37:42.505447 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:37:42.505447 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 255/512] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jul 15 20:37:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:37:42.505447 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f759e6c-0de5-4d64-8eed-9ccf117d9886 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:42.594191 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5ae6e1-c1fd-4ed5-8252-8022fd73b128 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:42.604451 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f759e6c-0de5-4d64-8eed-9ccf117d9886 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:42.627522 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd7f197-7916-4544-b8fa-62034332b081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:42.628339 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7f197-7916-4544-b8fa-62034332b081 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:42.628622 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7f197-7916-4544-b8fa-62034332b081 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:42.628902 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7f197-7916-4544-b8fa-62034332b081 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:42.638774 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd7f197-7916-4544-b8fa-62034332b081 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:42.638904 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf87c86-b171-4390-ac39-586fcc9ba1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:42.640210 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf87c86-b171-4390-ac39-586fcc9ba1f1 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:42.640496 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf87c86-b171-4390-ac39-586fcc9ba1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:42.640775 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf87c86-b171-4390-ac39-586fcc9ba1f1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:42.640880 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd7f197-7916-4544-b8fa-62034332b081 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:42.647424 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf87c86-b171-4390-ac39-586fcc9ba1f1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:42.648841 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf87c86-b171-4390-ac39-586fcc9ba1f1 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:42.658580 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-edd7f197-7916-4544-b8fa-62034332b081 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:37:42.658580 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:42.658580 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:42.658580 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:42.658580 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:42.658580 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:42.658580 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:42.658580 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:42.658580 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:42.658580 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:42.658580 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:42.658580 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:42.658580 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:37:42.658580 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:37:42.658580 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:37:42.659382 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:37:42.659382 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:42.659382 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:42.659382 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:42.659382 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:42.659382 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:42.659382 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:42.659382 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:42.659382 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:42.659382 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:42.659382 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:42.659382 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:42.659382 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:42.659382 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:42.659382 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:42.659382 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:42.659382 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:42.665125 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:37:42.665125 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:37:42.665125 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:37:42.665125 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:37:42.665125 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 258/513] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jul 15 20:37:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:37:42.665125 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd7f197-7916-4544-b8fa-62034332b081 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:42.665125 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:42.665526 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-eaf87c86-b171-4390-ac39-586fcc9ba1f1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:37:42.665526 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:42.665526 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:42.665526 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:42.665526 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:42.665526 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:42.665526 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:42.665526 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:42.665526 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:42.665526 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:42.665526 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:42.665526 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:42.665526 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 20:37:42.665526 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 20:37:42.665526 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 20:37:42.666671 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 20:37:42.666671 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:42.666671 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:42.666671 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:42.666671 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:42.666671 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:42.666671 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:42.666671 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:42.666671 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:42.666671 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:42.666671 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:42.666671 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:42.666671 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:42.666671 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:42.666671 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:42.666671 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:42.666671 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:42.667737 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 20:37:42.667737 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 20:37:42.667737 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 20:37:42.667737 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 20:37:42.667737 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 20:37:42.667737 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 20:37:42.667737 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:37:42.667737 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:37:42.667737 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 256/514] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jul 15 20:37:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:37:42.667737 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf87c86-b171-4390-ac39-586fcc9ba1f1 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:42.714670 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:42.762946 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd7f197-7916-4544-b8fa-62034332b081 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:42.768980 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf87c86-b171-4390-ac39-586fcc9ba1f1 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:42.796699 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341d8d4c-fef0-4b5b-abd3-6983e112c1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:42.797361 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d8d4c-fef0-4b5b-abd3-6983e112c1cb None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:42.797642 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d8d4c-fef0-4b5b-abd3-6983e112c1cb None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:42.797920 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d8d4c-fef0-4b5b-abd3-6983e112c1cb None admin] PATH_INFO: `/v3/users` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:42.798771 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341d8d4c-fef0-4b5b-abd3-6983e112c1cb None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:42.799081 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341d8d4c-fef0-4b5b-abd3-6983e112c1cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:42.800526 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341d8d4c-fef0-4b5b-abd3-6983e112c1cb None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:42.801676 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2428348-91e9-4f53-8a49-5c2bc439d6e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:42.802350 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2428348-91e9-4f53-8a49-5c2bc439d6e4 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:42.802636 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2428348-91e9-4f53-8a49-5c2bc439d6e4 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:42.802914 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2428348-91e9-4f53-8a49-5c2bc439d6e4 None admin] PATH_INFO: `/v3/domains` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:42.803623 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2428348-91e9-4f53-8a49-5c2bc439d6e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:42.803930 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2428348-91e9-4f53-8a49-5c2bc439d6e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:42.805269 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2428348-91e9-4f53-8a49-5c2bc439d6e4 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:42.817253 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 259/515] 10.222.0.16 () {56 vars in 1139 bytes} [Fri Jul 15 20:37:42 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:42.817379 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 257/516] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jul 15 20:37:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:42.817711 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341d8d4c-fef0-4b5b-abd3-6983e112c1cb None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:42.818654 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2428348-91e9-4f53-8a49-5c2bc439d6e4 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:42.875088 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:42.915610 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341d8d4c-fef0-4b5b-abd3-6983e112c1cb None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:42.920306 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2428348-91e9-4f53-8a49-5c2bc439d6e4 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:42.927548 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:42.949126 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9432df45-f33f-49b7-8fd5-03044cce7f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:42.949781 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9432df45-f33f-49b7-8fd5-03044cce7f8a None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:42.950066 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9432df45-f33f-49b7-8fd5-03044cce7f8a None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:42.950378 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9432df45-f33f-49b7-8fd5-03044cce7f8a None admin] PATH_INFO: `/v3/domains` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:42.951116 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9432df45-f33f-49b7-8fd5-03044cce7f8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:42.951428 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9432df45-f33f-49b7-8fd5-03044cce7f8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:42.953360 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9432df45-f33f-49b7-8fd5-03044cce7f8a None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:42.955400 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb0894f-5aad-43ce-81ac-0c61de62c441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:42.956054 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb0894f-5aad-43ce-81ac-0c61de62c441 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:42.956347 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb0894f-5aad-43ce-81ac-0c61de62c441 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:42.956632 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb0894f-5aad-43ce-81ac-0c61de62c441 None admin] PATH_INFO: `/v3/projects` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:42.957423 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb0894f-5aad-43ce-81ac-0c61de62c441 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:42.957867 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb0894f-5aad-43ce-81ac-0c61de62c441 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:42.959212 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb0894f-5aad-43ce-81ac-0c61de62c441 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:42.969415 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 260/517] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jul 15 20:37:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:42.970179 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9432df45-f33f-49b7-8fd5-03044cce7f8a None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:42.981102 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 258/518] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jul 15 20:37:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:42.981928 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb0894f-5aad-43ce-81ac-0c61de62c441 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:43.070109 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9432df45-f33f-49b7-8fd5-03044cce7f8a None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:43.080037 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb0894f-5aad-43ce-81ac-0c61de62c441 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:43.089506 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:43.104035 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd00173f-1c0c-4138-a93f-f89060d83891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:43.105006 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00173f-1c0c-4138-a93f-f89060d83891 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:43.105296 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00173f-1c0c-4138-a93f-f89060d83891 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:43.105576 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00173f-1c0c-4138-a93f-f89060d83891 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:43.112274 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd00173f-1c0c-4138-a93f-f89060d83891 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:43.113266 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2617ac52-3bdb-40ec-9f24-1143a29adda7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:43.113749 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd00173f-1c0c-4138-a93f-f89060d83891 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:43.113923 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2617ac52-3bdb-40ec-9f24-1143a29adda7 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:43.114209 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2617ac52-3bdb-40ec-9f24-1143a29adda7 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:43.114512 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2617ac52-3bdb-40ec-9f24-1143a29adda7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:43.129009 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-dd00173f-1c0c-4138-a93f-f89060d83891 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:37:43.129009 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:43.129009 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:43.129009 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:43.129009 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:43.129009 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:43.129009 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:43.129009 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:43.129009 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:43.129009 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:43.129009 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:43.129009 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:43.129009 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 20:37:43.129009 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 20:37:43.129009 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 20:37:43.129963 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 20:37:43.129963 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:43.129963 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:43.129963 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:43.129963 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:43.129963 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:43.129963 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:43.129963 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:43.129963 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:43.129963 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:43.129963 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:43.129963 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:43.129963 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:43.129963 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:43.129963 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:43.129963 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:43.129963 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:43.131124 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 20:37:43.131124 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 20:37:43.131124 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 20:37:43.131124 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 20:37:43.131124 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 20:37:43.131124 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 20:37:43.131124 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:37:43.131124 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:37:43.131124 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 261/519] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jul 15 20:37:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:37:43.131124 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd00173f-1c0c-4138-a93f-f89060d83891 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:43.153519 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:43.187584 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2617ac52-3bdb-40ec-9f24-1143a29adda7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:43.189073 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2617ac52-3bdb-40ec-9f24-1143a29adda7 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:43.228691 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd00173f-1c0c-4138-a93f-f89060d83891 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:43.261654 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273626a8-c192-4304-a98c-f16fc581c9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:43.262459 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273626a8-c192-4304-a98c-f16fc581c9da None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:43.262741 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273626a8-c192-4304-a98c-f16fc581c9da None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:43.263012 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273626a8-c192-4304-a98c-f16fc581c9da None admin] PATH_INFO: `/v3/projects/service` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:43.270276 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273626a8-c192-4304-a98c-f16fc581c9da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:43.271721 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273626a8-c192-4304-a98c-f16fc581c9da None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:43.285148 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-273626a8-c192-4304-a98c-f16fc581c9da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:37:43.285148 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:43.285148 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:43.285148 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:43.285148 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:43.285148 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:43.285148 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:43.285148 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:43.285148 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:43.285148 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:43.285148 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:43.285148 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:43.285148 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 20:37:43.285148 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 20:37:43.285148 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 20:37:43.285970 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 20:37:43.285970 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:43.285970 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:43.285970 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:43.285970 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:43.285970 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:43.285970 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:43.285970 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:43.285970 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:43.285970 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:43.285970 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:43.285970 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:43.285970 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:43.285970 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:43.285970 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:43.285970 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:43.285970 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:43.286848 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 20:37:43.286848 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 20:37:43.286848 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 20:37:43.286848 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 20:37:43.286848 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 20:37:43.286848 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 20:37:43.286848 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:37:43.286848 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:37:43.286848 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 262/520] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jul 15 20:37:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:37:43.287295 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 259/521] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jul 15 20:37:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:43.287937 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273626a8-c192-4304-a98c-f16fc581c9da None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:43.288037 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2617ac52-3bdb-40ec-9f24-1143a29adda7 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:43.330197 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:43.355440 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:43.388758 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273626a8-c192-4304-a98c-f16fc581c9da None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:43.389333 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2617ac52-3bdb-40ec-9f24-1143a29adda7 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:43.421588 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c51f76-fdd3-4db5-8ed1-ddeb3fdcf7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:43.422151 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce29b61-6e39-4705-a021-6a130bfbe690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:43.422296 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c51f76-fdd3-4db5-8ed1-ddeb3fdcf7b1 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:43.422538 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c51f76-fdd3-4db5-8ed1-ddeb3fdcf7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:43.422803 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce29b61-6e39-4705-a021-6a130bfbe690 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:43.422892 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c51f76-fdd3-4db5-8ed1-ddeb3fdcf7b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:43.423088 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce29b61-6e39-4705-a021-6a130bfbe690 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:43.423360 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce29b61-6e39-4705-a021-6a130bfbe690 None admin] PATH_INFO: `/v3/projects` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:43.423630 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c51f76-fdd3-4db5-8ed1-ddeb3fdcf7b1 None admin] RBAC: Adding query filter params (role.id=5661c06533c14256aa58c232ba9db7cb, scope.project.id=0ea017caabac4346a1fc822ddfe3e8c2, user.id=b3e5296637584004b1888453ab9056c4) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:43.423944 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c51f76-fdd3-4db5-8ed1-ddeb3fdcf7b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:43.424129 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce29b61-6e39-4705-a021-6a130bfbe690 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:43.424439 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce29b61-6e39-4705-a021-6a130bfbe690 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:43.425374 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c51f76-fdd3-4db5-8ed1-ddeb3fdcf7b1 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:43.425843 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce29b61-6e39-4705-a021-6a130bfbe690 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:43.430952 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 263/522] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jul 15 20:37:43 2022] GET /identity/v3/role_assignments?user.id=b3e5296637584004b1888453ab9056c4&scope.project.id=0ea017caabac4346a1fc822ddfe3e8c2&role.id=5661c06533c14256aa58c232ba9db7cb => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:43.431897 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c51f76-fdd3-4db5-8ed1-ddeb3fdcf7b1 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:43.440490 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 260/523] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jul 15 20:37:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:43.441195 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce29b61-6e39-4705-a021-6a130bfbe690 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:43.562789 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce29b61-6e39-4705-a021-6a130bfbe690 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:43.563757 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c51f76-fdd3-4db5-8ed1-ddeb3fdcf7b1 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:43.568028 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:43.593668 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:43.603917 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24448834-02ce-4487-bf9c-75fb7ddfc9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:43.604715 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24448834-02ce-4487-bf9c-75fb7ddfc9bc None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:43.605247 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24448834-02ce-4487-bf9c-75fb7ddfc9bc None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:43.605247 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24448834-02ce-4487-bf9c-75fb7ddfc9bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:43.606345 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd369759-8da8-47ba-bcd3-d84a74d6c6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:43.607005 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd369759-8da8-47ba-bcd3-d84a74d6c6af None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:43.607301 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd369759-8da8-47ba-bcd3-d84a74d6c6af None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:43.607574 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd369759-8da8-47ba-bcd3-d84a74d6c6af None admin] PATH_INFO: `/v3/projects` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:43.608395 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd369759-8da8-47ba-bcd3-d84a74d6c6af None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:43.608703 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd369759-8da8-47ba-bcd3-d84a74d6c6af None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:43.610906 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd369759-8da8-47ba-bcd3-d84a74d6c6af None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:43.616648 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24448834-02ce-4487-bf9c-75fb7ddfc9bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:43.618150 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24448834-02ce-4487-bf9c-75fb7ddfc9bc None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:43.628910 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 264/524] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jul 15 20:37:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:43.634358 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd369759-8da8-47ba-bcd3-d84a74d6c6af None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:43.636073 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-24448834-02ce-4487-bf9c-75fb7ddfc9bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:37:43.636073 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:43.636073 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:43.636073 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:43.636073 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:43.636073 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:43.636073 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:43.636073 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:43.636073 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:43.636073 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:43.636073 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:43.636073 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:43.636073 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:37:43.636073 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:37:43.636073 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:37:43.637010 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:37:43.637010 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:43.637010 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:43.637010 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:43.637010 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:43.637010 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:43.637010 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:43.637010 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:43.637010 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:43.637010 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:43.637010 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:43.637010 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:43.637010 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:43.637010 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:43.637010 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:43.637010 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:43.637010 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:43.637822 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:37:43.637822 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:37:43.637822 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:37:43.637822 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:37:43.637822 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 261/525] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jul 15 20:37:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:37:43.638691 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24448834-02ce-4487-bf9c-75fb7ddfc9bc None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:43.738878 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24448834-02ce-4487-bf9c-75fb7ddfc9bc None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:43.743658 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd369759-8da8-47ba-bcd3-d84a74d6c6af None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:43.772693 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6058a5ab-d076-4ab8-8cd1-dac53a762028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:43.773338 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058a5ab-d076-4ab8-8cd1-dac53a762028 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:43.773623 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058a5ab-d076-4ab8-8cd1-dac53a762028 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:43.773904 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058a5ab-d076-4ab8-8cd1-dac53a762028 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:43.774766 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6058a5ab-d076-4ab8-8cd1-dac53a762028 None admin] RBAC: Adding query filter params (role.id=5661c06533c14256aa58c232ba9db7cb, scope.project.id=0ea017caabac4346a1fc822ddfe3e8c2, user.id=d50ee89209d2474b8609861ed0a513e6) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:43.775082 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6058a5ab-d076-4ab8-8cd1-dac53a762028 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:43.776527 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6058a5ab-d076-4ab8-8cd1-dac53a762028 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:43.780189 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bc3b56-66e8-4ddc-8311-741be122ef50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:43.780842 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc3b56-66e8-4ddc-8311-741be122ef50 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:43.781131 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc3b56-66e8-4ddc-8311-741be122ef50 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:43.781413 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc3b56-66e8-4ddc-8311-741be122ef50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:43.790569 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 262/526] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jul 15 20:37:43 2022] GET /identity/v3/role_assignments?user.id=d50ee89209d2474b8609861ed0a513e6&scope.project.id=0ea017caabac4346a1fc822ddfe3e8c2&role.id=5661c06533c14256aa58c232ba9db7cb => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:43.790771 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bc3b56-66e8-4ddc-8311-741be122ef50 None admin] RBAC: Adding query filter params (role.id=5661c06533c14256aa58c232ba9db7cb, scope.project.id=0ea017caabac4346a1fc822ddfe3e8c2, user.id=2766cf20921045a896ff7735cc2534d6) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:43.790771 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bc3b56-66e8-4ddc-8311-741be122ef50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:43.790929 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6058a5ab-d076-4ab8-8cd1-dac53a762028 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:43.791008 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bc3b56-66e8-4ddc-8311-741be122ef50 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:43.800574 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 265/527] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jul 15 20:37:43 2022] GET /identity/v3/role_assignments?user.id=2766cf20921045a896ff7735cc2534d6&scope.project.id=0ea017caabac4346a1fc822ddfe3e8c2&role.id=5661c06533c14256aa58c232ba9db7cb => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:43.849299 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:43.929721 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6058a5ab-d076-4ab8-8cd1-dac53a762028 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:43.973498 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c842d3e-6566-49b7-b782-8c8c5df3a7ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:43.974246 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c842d3e-6566-49b7-b782-8c8c5df3a7ad None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:43.974537 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c842d3e-6566-49b7-b782-8c8c5df3a7ad None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:43.974822 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c842d3e-6566-49b7-b782-8c8c5df3a7ad None admin] PATH_INFO: `/v3/domains` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:43.975650 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c842d3e-6566-49b7-b782-8c8c5df3a7ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:43.975964 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c842d3e-6566-49b7-b782-8c8c5df3a7ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:43.977465 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c842d3e-6566-49b7-b782-8c8c5df3a7ad None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:43.992351 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 263/528] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jul 15 20:37:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:43.998106 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bc3b56-66e8-4ddc-8311-741be122ef50 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:44.030107 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:44.107012 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bc3b56-66e8-4ddc-8311-741be122ef50 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:44.142374 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e593de-1837-47e6-942c-5790d81b0a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:44.143170 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e593de-1837-47e6-942c-5790d81b0a3c None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:44.143458 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e593de-1837-47e6-942c-5790d81b0a3c None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:44.143738 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e593de-1837-47e6-942c-5790d81b0a3c None admin] PATH_INFO: `/v3/projects/service` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:44.150828 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e593de-1837-47e6-942c-5790d81b0a3c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:44.152281 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e593de-1837-47e6-942c-5790d81b0a3c None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:44.168746 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-f0e593de-1837-47e6-942c-5790d81b0a3c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:37:44.168746 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:44.168746 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:44.168746 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:44.168746 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:44.168746 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:44.168746 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:44.168746 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:44.168746 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:44.168746 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:44.168746 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:44.168746 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:44.168746 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 20:37:44.168746 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 20:37:44.168746 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 20:37:44.169637 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 20:37:44.169637 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:44.169637 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:44.169637 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:44.169637 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:44.169637 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:44.169637 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:44.169637 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:44.169637 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:44.169637 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:44.169637 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:44.169637 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:44.169637 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:44.169637 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:44.169637 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:44.169637 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:44.169637 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:44.171040 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 20:37:44.171040 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 20:37:44.171040 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 20:37:44.171040 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 20:37:44.171040 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 20:37:44.171040 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 20:37:44.171040 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:37:44.171040 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:37:44.171040 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 266/529] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jul 15 20:37:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:37:44.176956 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c842d3e-6566-49b7-b782-8c8c5df3a7ad None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:44.288256 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c842d3e-6566-49b7-b782-8c8c5df3a7ad None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:44.290107 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:44.329170 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b936b090-4c06-44f4-a09d-22d6f6454b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:44.330253 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936b090-4c06-44f4-a09d-22d6f6454b56 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:44.330839 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936b090-4c06-44f4-a09d-22d6f6454b56 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:44.331315 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936b090-4c06-44f4-a09d-22d6f6454b56 None admin] PATH_INFO: `/v3/projects` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:44.332353 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b936b090-4c06-44f4-a09d-22d6f6454b56 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:44.332862 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b936b090-4c06-44f4-a09d-22d6f6454b56 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:44.334540 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b936b090-4c06-44f4-a09d-22d6f6454b56 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:44.348192 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 264/530] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jul 15 20:37:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:37:44.354624 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e593de-1837-47e6-942c-5790d81b0a3c None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:44.446843 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:44.467265 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e593de-1837-47e6-942c-5790d81b0a3c None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:44.506429 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21f64a4-37a6-4586-8877-a5a15ffd76b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:44.507092 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f64a4-37a6-4586-8877-a5a15ffd76b7 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:44.507376 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f64a4-37a6-4586-8877-a5a15ffd76b7 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:44.507653 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f64a4-37a6-4586-8877-a5a15ffd76b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:44.508548 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21f64a4-37a6-4586-8877-a5a15ffd76b7 None admin] RBAC: Adding query filter params (role.id=5661c06533c14256aa58c232ba9db7cb, scope.project.id=0ea017caabac4346a1fc822ddfe3e8c2, user.id=3491680e892041678242f9b93617b9a6) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:44.508863 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21f64a4-37a6-4586-8877-a5a15ffd76b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:44.510359 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21f64a4-37a6-4586-8877-a5a15ffd76b7 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:44.517897 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 267/531] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jul 15 20:37:44 2022] GET /identity/v3/role_assignments?user.id=3491680e892041678242f9b93617b9a6&scope.project.id=0ea017caabac4346a1fc822ddfe3e8c2&role.id=5661c06533c14256aa58c232ba9db7cb => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:45.781423 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d82cb2c-d173-45d9-9ac3-0457b83f4ae5 None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:45.783177 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d82cb2c-d173-45d9-9ac3-0457b83f4ae5 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:45.783701 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d82cb2c-d173-45d9-9ac3-0457b83f4ae5 None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:45.787707 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 265/532] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:37:45 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:37:45.794757 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3cc513-2f1a-4920-9d5a-e3e4a2c81087 None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:45.795686 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3cc513-2f1a-4920-9d5a-e3e4a2c81087 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:45.796169 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3cc513-2f1a-4920-9d5a-e3e4a2c81087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:45.816411 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-4a3cc513-2f1a-4920-9d5a-e3e4a2c81087 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:45.817968 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-4a3cc513-2f1a-4920-9d5a-e3e4a2c81087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:45.892946 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 268/533] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:37:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:37:45.916411 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d82cb2c-d173-45d9-9ac3-0457b83f4ae5 None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:46.027377 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d82cb2c-d173-45d9-9ac3-0457b83f4ae5 None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:46.075430 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed696faf-06a5-4849-838a-02eed7ce21af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:46.076219 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed696faf-06a5-4849-838a-02eed7ce21af None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:46.076509 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed696faf-06a5-4849-838a-02eed7ce21af None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:46.076826 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed696faf-06a5-4849-838a-02eed7ce21af None admin] PATH_INFO: `/v3/roles/service` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:46.089293 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed696faf-06a5-4849-838a-02eed7ce21af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:37:46.098987 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-ed696faf-06a5-4849-838a-02eed7ce21af None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 20:37:46.098987 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:46.098987 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:46.098987 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:46.098987 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:46.098987 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:46.098987 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:46.098987 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:46.098987 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:46.098987 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:46.098987 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:46.098987 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:46.098987 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:37:46.098987 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:37:46.098987 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:37:46.098987 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:37:46.099842 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:37:46.099842 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:37:46.099842 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:37:46.099842 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:37:46.099842 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:46.099842 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:46.099842 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:46.099842 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:46.099842 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:46.099842 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:46.099842 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:46.099842 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:46.099842 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:46.099842 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:46.099842 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:46.099842 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:46.100816 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:46.100816 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:46.100816 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:46.100816 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:46.100816 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:37:46.100816 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:37:46.100816 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:37:46.100816 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:37:46.100816 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:37:46.100816 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:37:46.100816 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 20:37:46.100816 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:37:46.100816 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 266/534] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Jul 15 20:37:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:37:46.105947 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d086e6b7-882c-4ac6-a576-b19a6215dfa6 None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:46.106280 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d086e6b7-882c-4ac6-a576-b19a6215dfa6 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:46.106562 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d086e6b7-882c-4ac6-a576-b19a6215dfa6 None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:46.109114 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 269/535] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:37:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:37:46.109626 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed696faf-06a5-4849-838a-02eed7ce21af None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:46.114251 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d903bc-e68a-40f5-96c0-51deffe8ac03 None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:46.114547 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d903bc-e68a-40f5-96c0-51deffe8ac03 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:46.114830 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d903bc-e68a-40f5-96c0-51deffe8ac03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:46.134444 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-21d903bc-e68a-40f5-96c0-51deffe8ac03 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:46.135783 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-21d903bc-e68a-40f5-96c0-51deffe8ac03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:46.144784 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:46.240076 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 270/536] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:37:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 20:37:46.249898 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e16bd43-7c0e-467d-8ae7-d8b390334ab7 None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:46.250225 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e16bd43-7c0e-467d-8ae7-d8b390334ab7 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:46.250509 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e16bd43-7c0e-467d-8ae7-d8b390334ab7 None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:46.254964 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed696faf-06a5-4849-838a-02eed7ce21af None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:46.255953 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 271/537] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:37:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 20:37:46.257205 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7657f205-f559-4fd8-994b-51760bc97d64 None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:46.257542 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7657f205-f559-4fd8-994b-51760bc97d64 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:46.257778 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7657f205-f559-4fd8-994b-51760bc97d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:46.275245 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-7657f205-f559-4fd8-994b-51760bc97d64 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:46.276439 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-7657f205-f559-4fd8-994b-51760bc97d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:46.283922 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:46.294480 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7f1e28-00bc-4d84-8067-56ccc83ce15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:46.295236 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f1e28-00bc-4d84-8067-56ccc83ce15e None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:46.295549 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f1e28-00bc-4d84-8067-56ccc83ce15e None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:46.295826 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f1e28-00bc-4d84-8067-56ccc83ce15e None admin] PATH_INFO: `/v3/roles` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:46.296560 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7f1e28-00bc-4d84-8067-56ccc83ce15e None admin] RBAC: Adding query filter params (name=service) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:46.296867 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7f1e28-00bc-4d84-8067-56ccc83ce15e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:46.298367 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7f1e28-00bc-4d84-8067-56ccc83ce15e None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:46.308771 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 267/538] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Jul 15 20:37:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:46.309674 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7f1e28-00bc-4d84-8067-56ccc83ce15e None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:46.352154 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 272/539] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:37:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:37:46.354963 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7657f205-f559-4fd8-994b-51760bc97d64 None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:46.403467 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:46.420037 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7f1e28-00bc-4d84-8067-56ccc83ce15e None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:46.457517 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123fa57b-33fe-43d2-a177-f45a6e763fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:46.458483 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123fa57b-33fe-43d2-a177-f45a6e763fee None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:46.458763 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123fa57b-33fe-43d2-a177-f45a6e763fee None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:46.459046 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123fa57b-33fe-43d2-a177-f45a6e763fee None admin] PATH_INFO: `/v3/roles/service` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:46.469393 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123fa57b-33fe-43d2-a177-f45a6e763fee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:37:46.477097 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-123fa57b-33fe-43d2-a177-f45a6e763fee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 20:37:46.477097 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:46.477097 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:46.477097 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:46.477097 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:46.477097 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:46.477097 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:46.477097 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:46.477097 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:46.477097 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:46.477097 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:46.477097 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:46.477097 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:37:46.477097 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:37:46.477097 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:37:46.477097 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:37:46.478514 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:37:46.478514 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:37:46.478514 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:37:46.478514 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:37:46.478514 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:46.478514 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:46.478514 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:46.478514 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:46.478514 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:46.478514 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:46.478514 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:46.478514 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:46.478514 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:46.478514 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:46.478514 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:46.478514 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:46.479301 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:46.479301 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:46.479301 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:46.479301 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:46.479301 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:37:46.479301 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:37:46.479301 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:37:46.479301 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:37:46.479301 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:37:46.479301 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:37:46.479301 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 20:37:46.479301 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:37:46.479301 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 268/540] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Jul 15 20:37:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:37:46.479301 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123fa57b-33fe-43d2-a177-f45a6e763fee None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:46.480872 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7657f205-f559-4fd8-994b-51760bc97d64 None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:46.519300 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93ef6e5-245d-41f0-9dbb-1c373faae26b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:46.520089 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ef6e5-245d-41f0-9dbb-1c373faae26b None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:46.520373 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ef6e5-245d-41f0-9dbb-1c373faae26b None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:46.520653 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ef6e5-245d-41f0-9dbb-1c373faae26b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:46.530788 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93ef6e5-245d-41f0-9dbb-1c373faae26b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:46.532279 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93ef6e5-245d-41f0-9dbb-1c373faae26b None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:46.534017 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:46.557762 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-e93ef6e5-245d-41f0-9dbb-1c373faae26b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:37:46.557762 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:46.557762 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:46.557762 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:46.557762 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:46.557762 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:46.557762 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:46.557762 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:46.557762 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:46.557762 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:46.557762 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:46.557762 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:46.557762 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:37:46.557762 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:37:46.557762 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:37:46.558701 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:37:46.558701 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:46.558701 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:46.558701 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:46.558701 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:46.558701 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:46.558701 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:46.558701 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:46.558701 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:46.558701 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:46.558701 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:46.558701 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:46.558701 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:46.558701 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:46.558701 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:46.558701 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:46.558701 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:46.559527 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:37:46.559527 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:37:46.559527 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:37:46.559527 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:37:46.559527 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 273/541] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jul 15 20:37:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:37:46.561968 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93ef6e5-245d-41f0-9dbb-1c373faae26b None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:46.600882 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123fa57b-33fe-43d2-a177-f45a6e763fee None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:46.639896 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a13ee49-cdd7-4aa8-8879-56f456570a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:46.640949 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a13ee49-cdd7-4aa8-8879-56f456570a1e None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:46.641440 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a13ee49-cdd7-4aa8-8879-56f456570a1e None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:46.641908 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a13ee49-cdd7-4aa8-8879-56f456570a1e None admin] PATH_INFO: `/v3/roles/service` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:46.655091 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a13ee49-cdd7-4aa8-8879-56f456570a1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:37:46.664143 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-9a13ee49-cdd7-4aa8-8879-56f456570a1e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 20:37:46.664143 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:46.664143 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:46.664143 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:46.664143 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:46.664143 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:46.664143 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:46.664143 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:46.664143 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:46.664143 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:46.664143 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:46.664143 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:46.664143 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:37:46.664143 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:37:46.664143 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:37:46.664143 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:37:46.665327 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:37:46.665327 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:37:46.665327 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:37:46.665327 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:37:46.665327 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:46.665327 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:46.665327 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:46.665327 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:46.665327 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:46.665327 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:46.665327 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:46.665327 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:46.665327 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:46.665327 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:46.665327 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:46.665327 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:46.666314 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:46.666314 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:46.666314 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:46.666314 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:46.666314 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:37:46.666314 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:37:46.666314 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:37:46.666314 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:37:46.666314 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:37:46.666314 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:37:46.666314 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 20:37:46.666314 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:37:46.668785 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 269/542] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Jul 15 20:37:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:37:46.669643 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a13ee49-cdd7-4aa8-8879-56f456570a1e None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:46.675452 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:46.676197 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93ef6e5-245d-41f0-9dbb-1c373faae26b None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:46.712957 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a8eb1e-52b4-4469-88d1-6775cfb5136c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:46.713624 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a8eb1e-52b4-4469-88d1-6775cfb5136c None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:46.713911 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a8eb1e-52b4-4469-88d1-6775cfb5136c None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:46.714289 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a8eb1e-52b4-4469-88d1-6775cfb5136c None admin] PATH_INFO: `/v3/roles` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:46.715031 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a8eb1e-52b4-4469-88d1-6775cfb5136c None admin] RBAC: Adding query filter params (name=service) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:46.715340 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a8eb1e-52b4-4469-88d1-6775cfb5136c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:46.716705 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a8eb1e-52b4-4469-88d1-6775cfb5136c None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:46.726324 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 274/543] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Jul 15 20:37:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:46.727458 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a8eb1e-52b4-4469-88d1-6775cfb5136c None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:46.779424 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a13ee49-cdd7-4aa8-8879-56f456570a1e None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:46.792306 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:46.814692 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d38c47e-36a2-4083-aea6-d3b0eccf9d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:46.815369 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d38c47e-36a2-4083-aea6-d3b0eccf9d24 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:46.815658 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d38c47e-36a2-4083-aea6-d3b0eccf9d24 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:46.815938 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d38c47e-36a2-4083-aea6-d3b0eccf9d24 None admin] PATH_INFO: `/v3/domains` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:46.816660 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d38c47e-36a2-4083-aea6-d3b0eccf9d24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:46.816972 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d38c47e-36a2-4083-aea6-d3b0eccf9d24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:46.818464 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d38c47e-36a2-4083-aea6-d3b0eccf9d24 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:46.830414 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 270/544] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jul 15 20:37:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:46.831063 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d38c47e-36a2-4083-aea6-d3b0eccf9d24 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:46.836300 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a8eb1e-52b4-4469-88d1-6775cfb5136c None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:46.870207 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c772c053-a3f4-41bd-bc38-843860ca6af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:46.870876 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c772c053-a3f4-41bd-bc38-843860ca6af4 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:46.871165 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c772c053-a3f4-41bd-bc38-843860ca6af4 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:46.871448 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c772c053-a3f4-41bd-bc38-843860ca6af4 None admin] PATH_INFO: `/v3/roles` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:46.872189 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c772c053-a3f4-41bd-bc38-843860ca6af4 None admin] RBAC: Adding query filter params (name=service) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:46.872500 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c772c053-a3f4-41bd-bc38-843860ca6af4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:46.873902 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c772c053-a3f4-41bd-bc38-843860ca6af4 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:46.881936 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 275/545] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Jul 15 20:37:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:46.883162 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4fa16-9104-4587-a788-545d34dcc454 None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:46.883452 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4fa16-9104-4587-a788-545d34dcc454 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:46.883734 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4fa16-9104-4587-a788-545d34dcc454 None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:46.884951 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 276/546] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:37:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:37:46.889191 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc4fa16-9104-4587-a788-545d34dcc454 None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:46.896060 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:46.933499 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d38c47e-36a2-4083-aea6-d3b0eccf9d24 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:46.967988 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12620d84-ce9a-45e0-99d4-68d0e45b8612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:46.968771 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12620d84-ce9a-45e0-99d4-68d0e45b8612 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:46.969057 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12620d84-ce9a-45e0-99d4-68d0e45b8612 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:46.969339 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12620d84-ce9a-45e0-99d4-68d0e45b8612 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:46.979150 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12620d84-ce9a-45e0-99d4-68d0e45b8612 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:46.980590 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12620d84-ce9a-45e0-99d4-68d0e45b8612 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:46.986696 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc4fa16-9104-4587-a788-545d34dcc454 None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:46.998282 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-12620d84-ce9a-45e0-99d4-68d0e45b8612 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:37:46.998282 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:46.998282 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:46.998282 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:46.998282 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:46.998282 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:46.998282 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:46.998282 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:46.998282 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:46.998282 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:46.998282 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:46.998282 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:46.998282 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:37:46.998282 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:37:46.998282 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:37:46.999202 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:37:46.999202 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:46.999202 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:46.999202 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:46.999202 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:46.999202 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:46.999202 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:46.999202 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:46.999202 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:46.999202 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:46.999202 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:46.999202 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:46.999202 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:46.999202 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:46.999202 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:46.999202 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:46.999202 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:47.000044 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:37:47.000044 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:37:47.000044 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:37:47.000044 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:37:47.000044 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 271/547] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jul 15 20:37:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:37:47.000325 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12620d84-ce9a-45e0-99d4-68d0e45b8612 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:47.007865 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:47.024605 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd44303-2e1f-4814-ad48-34dcd21d801c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:47.025396 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd44303-2e1f-4814-ad48-34dcd21d801c None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:47.025714 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd44303-2e1f-4814-ad48-34dcd21d801c None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:47.025995 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd44303-2e1f-4814-ad48-34dcd21d801c None admin] PATH_INFO: `/v3/users/nova` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:47.033982 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd44303-2e1f-4814-ad48-34dcd21d801c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:47.035460 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd44303-2e1f-4814-ad48-34dcd21d801c None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:47.049744 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-ecd44303-2e1f-4814-ad48-34dcd21d801c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 15 20:37:47.049744 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:47.049744 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:47.049744 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:47.049744 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:47.049744 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:47.049744 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:47.049744 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:47.049744 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:47.049744 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:47.049744 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:47.049744 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:47.049744 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 20:37:47.049744 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 20:37:47.049744 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 20:37:47.049744 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 20:37:47.050648 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:47.050648 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:47.050648 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 20:37:47.050648 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:37:47.050648 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 20:37:47.050648 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:37:47.050648 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:47.050648 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:47.050648 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:47.050648 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:47.050648 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:47.050648 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:47.050648 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:47.050648 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:47.050648 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:47.050648 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:47.050648 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:47.050648 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:47.051501 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:47.051501 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:47.051501 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 20:37:47.051501 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 20:37:47.051501 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 20:37:47.051501 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 20:37:47.051501 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 20:37:47.051501 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 20:37:47.051501 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 15 20:37:47.051501 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:37:47.051501 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 277/548] 10.222.0.16 () {56 vars in 1093 bytes} [Fri Jul 15 20:37:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:37:47.052543 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a31f2c-593f-4308-b837-205f1e89f7e3 None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:47.052824 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a31f2c-593f-4308-b837-205f1e89f7e3 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:47.053108 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a31f2c-593f-4308-b837-205f1e89f7e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:47.069444 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-77a31f2c-593f-4308-b837-205f1e89f7e3 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:47.071041 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-77a31f2c-593f-4308-b837-205f1e89f7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:47.110003 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12620d84-ce9a-45e0-99d4-68d0e45b8612 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:47.125649 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:47.136785 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 278/549] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:37:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:37:47.137605 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a31f2c-593f-4308-b837-205f1e89f7e3 None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:47.143466 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e3ebb0-4597-4102-80f1-1e2787d965ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:47.144251 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3ebb0-4597-4102-80f1-1e2787d965ac None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:47.144536 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3ebb0-4597-4102-80f1-1e2787d965ac None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:47.144816 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3ebb0-4597-4102-80f1-1e2787d965ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:47.156122 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e3ebb0-4597-4102-80f1-1e2787d965ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:47.157489 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e3ebb0-4597-4102-80f1-1e2787d965ac None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:47.174378 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-41e3ebb0-4597-4102-80f1-1e2787d965ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:37:47.174378 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:47.174378 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:47.174378 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:47.174378 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:47.174378 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:47.174378 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:47.174378 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:47.174378 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:47.174378 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:47.174378 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:47.174378 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:47.174378 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:37:47.174378 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:37:47.174378 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:37:47.175306 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:37:47.175306 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:47.175306 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:47.175306 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:47.175306 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:47.175306 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:47.175306 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:47.175306 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:47.175306 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:47.175306 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:47.175306 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:47.175306 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:47.175306 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:47.175306 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:47.175306 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:47.175306 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:47.175306 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:47.176370 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:37:47.176370 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:37:47.176370 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:37:47.176370 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:37:47.176370 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 272/550] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jul 15 20:37:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:37:47.176370 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e3ebb0-4597-4102-80f1-1e2787d965ac None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:47.235773 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a31f2c-593f-4308-b837-205f1e89f7e3 None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:47.245509 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:47.270448 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65b3912-f00d-431f-ade6-9dc5b4a794ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:47.271117 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b3912-f00d-431f-ade6-9dc5b4a794ff None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:47.271407 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b3912-f00d-431f-ade6-9dc5b4a794ff None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:47.271686 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b3912-f00d-431f-ade6-9dc5b4a794ff None admin] PATH_INFO: `/v3/domains` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:47.272402 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65b3912-f00d-431f-ade6-9dc5b4a794ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:47.272714 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65b3912-f00d-431f-ade6-9dc5b4a794ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:47.273758 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e3ebb0-4597-4102-80f1-1e2787d965ac None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:47.274123 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65b3912-f00d-431f-ade6-9dc5b4a794ff None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:47.287482 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 279/551] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jul 15 20:37:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:47.288278 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65b3912-f00d-431f-ade6-9dc5b4a794ff None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:47.307696 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7422fcad-9843-4da0-8921-1e552108119d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:47.308359 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7422fcad-9843-4da0-8921-1e552108119d None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:47.308647 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7422fcad-9843-4da0-8921-1e552108119d None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:47.308926 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7422fcad-9843-4da0-8921-1e552108119d None admin] PATH_INFO: `/v3/users` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:47.309753 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7422fcad-9843-4da0-8921-1e552108119d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:47.310102 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7422fcad-9843-4da0-8921-1e552108119d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:47.312110 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7422fcad-9843-4da0-8921-1e552108119d None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:47.329741 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 273/552] 10.222.0.16 () {56 vars in 1133 bytes} [Fri Jul 15 20:37:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:47.330750 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7422fcad-9843-4da0-8921-1e552108119d None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:47.360347 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:47.386990 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65b3912-f00d-431f-ade6-9dc5b4a794ff None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:47.420933 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7895f9d-9507-4b72-bcfa-8bb88aad1f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:47.421656 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7895f9d-9507-4b72-bcfa-8bb88aad1f38 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:47.421949 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7895f9d-9507-4b72-bcfa-8bb88aad1f38 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:47.422261 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7895f9d-9507-4b72-bcfa-8bb88aad1f38 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:47.432861 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7895f9d-9507-4b72-bcfa-8bb88aad1f38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:37:47.433472 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7422fcad-9843-4da0-8921-1e552108119d None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:47.448246 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-c7895f9d-9507-4b72-bcfa-8bb88aad1f38 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 20:37:47.448246 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:47.448246 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:47.448246 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:47.448246 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:47.448246 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:47.448246 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:47.448246 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:47.448246 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:47.448246 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:47.448246 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:47.448246 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:47.448246 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:37:47.448246 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:37:47.448246 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:37:47.448246 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:37:47.449584 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:37:47.449584 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:37:47.449584 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:37:47.449584 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:37:47.449584 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:47.449584 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:47.449584 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:47.449584 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:47.449584 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:47.449584 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:47.449584 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:47.449584 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:47.449584 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:47.449584 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:47.449584 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:47.449584 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:47.450602 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:47.450602 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:47.450602 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:47.450602 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:47.450602 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:37:47.450602 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:37:47.450602 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:37:47.450602 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:37:47.450602 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:37:47.450602 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:37:47.450602 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 20:37:47.450602 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:37:47.450602 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 280/553] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Jul 15 20:37:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:37:47.451806 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7895f9d-9507-4b72-bcfa-8bb88aad1f38 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:47.478001 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690125db-04d0-485a-b80c-4b2de842570a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:47.478716 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690125db-04d0-485a-b80c-4b2de842570a None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:47.479002 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690125db-04d0-485a-b80c-4b2de842570a None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:47.479274 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690125db-04d0-485a-b80c-4b2de842570a None admin] PATH_INFO: `/v3/domains` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:47.479993 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690125db-04d0-485a-b80c-4b2de842570a None admin] RBAC: Adding query filter params (name=Default) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:47.480297 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690125db-04d0-485a-b80c-4b2de842570a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:47.480846 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:47.481660 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690125db-04d0-485a-b80c-4b2de842570a None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:47.493540 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 274/554] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jul 15 20:37:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:47.494370 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690125db-04d0-485a-b80c-4b2de842570a None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:47.559290 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7895f9d-9507-4b72-bcfa-8bb88aad1f38 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:47.578183 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:47.592077 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e3c3d9-38a5-4395-ab22-a09aa2ac13c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:47.593374 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3c3d9-38a5-4395-ab22-a09aa2ac13c6 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:47.593657 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3c3d9-38a5-4395-ab22-a09aa2ac13c6 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:47.593932 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3c3d9-38a5-4395-ab22-a09aa2ac13c6 None admin] PATH_INFO: `/v3/users/glance` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:47.594575 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690125db-04d0-485a-b80c-4b2de842570a None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:47.601336 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e3c3d9-38a5-4395-ab22-a09aa2ac13c6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:47.602799 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e3c3d9-38a5-4395-ab22-a09aa2ac13c6 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:47.617048 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-50e3c3d9-38a5-4395-ab22-a09aa2ac13c6 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 15 20:37:47.617048 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:47.617048 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:47.617048 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:47.617048 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:47.617048 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:47.617048 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:47.617048 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:47.617048 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:47.617048 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:47.617048 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:47.617048 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:47.617048 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 20:37:47.617048 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 20:37:47.617048 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 20:37:47.617048 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 20:37:47.618160 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:47.618160 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:47.618160 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 20:37:47.618160 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:37:47.618160 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 20:37:47.618160 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:37:47.618160 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:47.618160 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:47.618160 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:47.618160 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:47.618160 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:47.618160 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:47.618160 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:47.618160 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:47.618160 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:47.618160 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:47.618160 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:47.618160 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:47.619175 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:47.619175 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:47.619175 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 20:37:47.619175 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 20:37:47.619175 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 20:37:47.619175 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 20:37:47.619175 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 20:37:47.619175 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 20:37:47.619175 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 15 20:37:47.619175 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:37:47.619175 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 281/555] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jul 15 20:37:47 2022] GET /identity/v3/users/glance => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:37:47.619175 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e3c3d9-38a5-4395-ab22-a09aa2ac13c6 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:47.631489 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e676970f-9d5e-4006-b0f5-a979180da904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:47.632272 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e676970f-9d5e-4006-b0f5-a979180da904 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:47.632559 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e676970f-9d5e-4006-b0f5-a979180da904 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:47.632836 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e676970f-9d5e-4006-b0f5-a979180da904 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:47.643220 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e676970f-9d5e-4006-b0f5-a979180da904 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:47.644663 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e676970f-9d5e-4006-b0f5-a979180da904 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:47.661713 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-e676970f-9d5e-4006-b0f5-a979180da904 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:37:47.661713 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:47.661713 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:47.661713 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:47.661713 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:47.661713 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:47.661713 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:47.661713 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:47.661713 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:47.661713 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:47.661713 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:47.661713 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:47.661713 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:37:47.661713 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:37:47.661713 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:37:47.662704 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:37:47.662704 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:47.662704 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:47.662704 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:47.662704 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:47.662704 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:47.662704 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:47.662704 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:47.662704 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:47.662704 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:47.662704 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:47.662704 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:47.662704 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:47.662704 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:47.662704 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:47.662704 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:47.662704 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:47.663552 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:37:47.663552 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:37:47.663552 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:37:47.663552 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:37:47.663552 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 275/556] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jul 15 20:37:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:37:47.664067 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e676970f-9d5e-4006-b0f5-a979180da904 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:47.709335 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:47.722954 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e3c3d9-38a5-4395-ab22-a09aa2ac13c6 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:47.755600 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dc453b-c423-4b87-a3b0-ae98844903f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:47.756263 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc453b-c423-4b87-a3b0-ae98844903f9 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:47.756551 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc453b-c423-4b87-a3b0-ae98844903f9 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:47.756825 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc453b-c423-4b87-a3b0-ae98844903f9 None admin] PATH_INFO: `/v3/roles` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:47.757654 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dc453b-c423-4b87-a3b0-ae98844903f9 None admin] RBAC: Adding query filter params (name=service) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:47.757961 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dc453b-c423-4b87-a3b0-ae98844903f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:47.759357 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dc453b-c423-4b87-a3b0-ae98844903f9 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:47.763615 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e676970f-9d5e-4006-b0f5-a979180da904 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:47.767045 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 282/557] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Jul 15 20:37:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:47.767871 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dc453b-c423-4b87-a3b0-ae98844903f9 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:47.797165 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be902616-4957-4f39-9288-726137ff5b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:47.797948 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be902616-4957-4f39-9288-726137ff5b51 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:47.798266 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be902616-4957-4f39-9288-726137ff5b51 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:47.798547 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be902616-4957-4f39-9288-726137ff5b51 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:47.805878 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be902616-4957-4f39-9288-726137ff5b51 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:47.807354 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be902616-4957-4f39-9288-726137ff5b51 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:47.809101 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:47.822908 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-be902616-4957-4f39-9288-726137ff5b51 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 15 20:37:47.822908 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:47.822908 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:47.822908 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:47.822908 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:47.822908 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:47.822908 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:47.822908 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:47.822908 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:47.822908 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:47.822908 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:47.822908 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:47.822908 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 20:37:47.822908 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 20:37:47.822908 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 20:37:47.822908 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 20:37:47.824846 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:47.824846 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:47.824846 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 20:37:47.824846 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:37:47.824846 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 20:37:47.824846 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:37:47.824846 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:47.824846 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:47.824846 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:47.824846 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:47.824846 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:47.824846 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:47.824846 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:47.824846 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:47.824846 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:47.824846 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:47.824846 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:47.824846 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:47.825755 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:47.825755 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:47.825755 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 20:37:47.825755 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 20:37:47.825755 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 20:37:47.825755 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 20:37:47.825755 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 20:37:47.825755 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 20:37:47.825755 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 15 20:37:47.825755 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:37:47.826298 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 276/558] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jul 15 20:37:47 2022] GET /identity/v3/users/cinder => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:37:47.827474 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be902616-4957-4f39-9288-726137ff5b51 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:47.868791 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dc453b-c423-4b87-a3b0-ae98844903f9 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:47.901732 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03973ce2-68ea-4d29-b010-3fc1b1abbe52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:47.902429 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03973ce2-68ea-4d29-b010-3fc1b1abbe52 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:47.902724 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03973ce2-68ea-4d29-b010-3fc1b1abbe52 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:47.903009 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03973ce2-68ea-4d29-b010-3fc1b1abbe52 None admin] PATH_INFO: `/v3/users` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:47.903838 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03973ce2-68ea-4d29-b010-3fc1b1abbe52 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:47.904154 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03973ce2-68ea-4d29-b010-3fc1b1abbe52 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:47.906253 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03973ce2-68ea-4d29-b010-3fc1b1abbe52 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:47.927157 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 283/559] 10.222.0.16 () {56 vars in 1137 bytes} [Fri Jul 15 20:37:47 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:47.927157 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03973ce2-68ea-4d29-b010-3fc1b1abbe52 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:47.927408 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be902616-4957-4f39-9288-726137ff5b51 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:47.935381 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:47.959735 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5624e68-6522-4bf4-b41e-25f45a7f3175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:47.960325 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5624e68-6522-4bf4-b41e-25f45a7f3175 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:47.960610 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5624e68-6522-4bf4-b41e-25f45a7f3175 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:47.960889 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5624e68-6522-4bf4-b41e-25f45a7f3175 None admin] PATH_INFO: `/v3/domains` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:47.961614 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5624e68-6522-4bf4-b41e-25f45a7f3175 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:47.961920 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5624e68-6522-4bf4-b41e-25f45a7f3175 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:47.963323 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5624e68-6522-4bf4-b41e-25f45a7f3175 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:47.975830 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 277/560] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jul 15 20:37:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:47.976621 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5624e68-6522-4bf4-b41e-25f45a7f3175 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:48.026093 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03973ce2-68ea-4d29-b010-3fc1b1abbe52 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:48.035294 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:48.059977 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffd223e-4801-4dd7-9b4d-ad30a5691803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:48.060767 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd223e-4801-4dd7-9b4d-ad30a5691803 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:48.061086 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd223e-4801-4dd7-9b4d-ad30a5691803 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:48.061370 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd223e-4801-4dd7-9b4d-ad30a5691803 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:48.071560 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffd223e-4801-4dd7-9b4d-ad30a5691803 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:48.073031 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffd223e-4801-4dd7-9b4d-ad30a5691803 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:48.077829 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5624e68-6522-4bf4-b41e-25f45a7f3175 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:48.090894 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-2ffd223e-4801-4dd7-9b4d-ad30a5691803 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:37:48.090894 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:48.090894 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:48.090894 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:48.090894 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:48.090894 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:48.090894 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:48.090894 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:48.090894 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:48.090894 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:48.090894 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:48.090894 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:48.090894 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:37:48.090894 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:37:48.090894 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:37:48.091776 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:37:48.091776 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:48.091776 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:48.091776 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:48.091776 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:48.091776 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:48.091776 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:48.091776 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:48.091776 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:48.091776 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:48.091776 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:48.091776 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:48.091776 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:48.091776 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:48.091776 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:48.091776 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:48.091776 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:48.093230 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:37:48.093230 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:37:48.093230 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:37:48.093230 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:37:48.093230 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 284/561] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jul 15 20:37:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:37:48.093500 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffd223e-4801-4dd7-9b4d-ad30a5691803 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:48.115268 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7895f900-3f3a-449e-b6d7-1f140c5c18b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:48.115936 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895f900-3f3a-449e-b6d7-1f140c5c18b9 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:48.116226 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895f900-3f3a-449e-b6d7-1f140c5c18b9 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:48.116508 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895f900-3f3a-449e-b6d7-1f140c5c18b9 None admin] PATH_INFO: `/v3/users` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:48.117348 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7895f900-3f3a-449e-b6d7-1f140c5c18b9 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:48.117666 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7895f900-3f3a-449e-b6d7-1f140c5c18b9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:48.119159 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7895f900-3f3a-449e-b6d7-1f140c5c18b9 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:48.135938 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 278/562] 10.222.0.16 () {56 vars in 1137 bytes} [Fri Jul 15 20:37:47 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:48.136731 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7895f900-3f3a-449e-b6d7-1f140c5c18b9 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:48.152000 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:48.193006 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffd223e-4801-4dd7-9b4d-ad30a5691803 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:48.229807 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bed32a-8cec-416d-b43c-f4095735ba10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:48.230579 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bed32a-8cec-416d-b43c-f4095735ba10 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:48.230870 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bed32a-8cec-416d-b43c-f4095735ba10 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:48.231148 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bed32a-8cec-416d-b43c-f4095735ba10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:48.235234 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7895f900-3f3a-449e-b6d7-1f140c5c18b9 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:48.241114 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bed32a-8cec-416d-b43c-f4095735ba10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:48.242601 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bed32a-8cec-416d-b43c-f4095735ba10 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:48.251981 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:48.260960 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-12bed32a-8cec-416d-b43c-f4095735ba10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:37:48.260960 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:48.260960 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:48.260960 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:48.260960 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:48.260960 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:48.260960 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:48.260960 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:48.260960 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:48.260960 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:48.260960 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:48.260960 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:48.260960 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:37:48.260960 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:37:48.260960 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:37:48.261825 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:37:48.261825 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:48.261825 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:48.261825 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:48.261825 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:48.261825 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:48.261825 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:48.261825 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:48.261825 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:48.261825 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:48.261825 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:48.261825 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:48.261825 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:48.261825 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:48.261825 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:48.261825 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:48.261825 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:48.263004 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:37:48.263004 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:37:48.263004 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:37:48.263004 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:37:48.263004 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 285/563] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jul 15 20:37:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:37:48.263004 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bed32a-8cec-416d-b43c-f4095735ba10 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:48.273354 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19339d27-63dc-4d13-9887-8346bdf529e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:48.274260 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19339d27-63dc-4d13-9887-8346bdf529e4 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:48.274619 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19339d27-63dc-4d13-9887-8346bdf529e4 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:48.274907 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19339d27-63dc-4d13-9887-8346bdf529e4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:48.281817 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19339d27-63dc-4d13-9887-8346bdf529e4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:48.283603 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19339d27-63dc-4d13-9887-8346bdf529e4 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:48.298770 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-19339d27-63dc-4d13-9887-8346bdf529e4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:37:48.298770 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:48.298770 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:48.298770 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:48.298770 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:48.298770 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:48.298770 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:48.298770 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:48.298770 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:48.298770 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:48.298770 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:48.298770 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:48.298770 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 20:37:48.298770 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 20:37:48.298770 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 20:37:48.299691 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 20:37:48.299691 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:48.299691 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:48.299691 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:48.299691 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:48.299691 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:48.299691 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:48.299691 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:48.299691 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:48.299691 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:48.299691 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:48.299691 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:48.299691 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:48.299691 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:48.299691 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:48.299691 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:48.299691 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:48.300542 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 20:37:48.300542 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 20:37:48.300542 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 20:37:48.300542 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 20:37:48.300542 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 20:37:48.300542 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 20:37:48.300542 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:37:48.300542 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:37:48.300542 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 279/564] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jul 15 20:37:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:37:48.301011 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19339d27-63dc-4d13-9887-8346bdf529e4 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:48.367856 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bed32a-8cec-416d-b43c-f4095735ba10 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:48.381118 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:48.402466 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98f5284-5b4d-4a45-b200-bf7bb3ebdca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:48.403121 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19339d27-63dc-4d13-9887-8346bdf529e4 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:48.403233 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f5284-5b4d-4a45-b200-bf7bb3ebdca5 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:48.403403 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f5284-5b4d-4a45-b200-bf7bb3ebdca5 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:48.403678 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f5284-5b4d-4a45-b200-bf7bb3ebdca5 None admin] PATH_INFO: `/v3/domains` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:48.404384 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98f5284-5b4d-4a45-b200-bf7bb3ebdca5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:48.404692 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98f5284-5b4d-4a45-b200-bf7bb3ebdca5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:48.406140 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98f5284-5b4d-4a45-b200-bf7bb3ebdca5 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:48.417150 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 286/565] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jul 15 20:37:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:48.419141 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98f5284-5b4d-4a45-b200-bf7bb3ebdca5 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:48.435807 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ef6acf-1490-44a9-a21b-53f30a06456a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:48.437187 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef6acf-1490-44a9-a21b-53f30a06456a None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:48.437476 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef6acf-1490-44a9-a21b-53f30a06456a None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:48.437748 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef6acf-1490-44a9-a21b-53f30a06456a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:48.449124 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ef6acf-1490-44a9-a21b-53f30a06456a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:48.450604 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ef6acf-1490-44a9-a21b-53f30a06456a None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:48.468837 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-a2ef6acf-1490-44a9-a21b-53f30a06456a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:37:48.468837 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:48.468837 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:48.468837 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:48.468837 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:48.468837 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:48.468837 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:48.468837 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:48.468837 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:48.468837 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:48.468837 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:48.468837 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:48.468837 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:37:48.468837 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:37:48.468837 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:37:48.469813 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:37:48.469813 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:48.469813 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:48.469813 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:48.469813 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:48.469813 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:48.469813 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:48.469813 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:48.469813 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:48.469813 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:48.469813 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:48.469813 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:48.469813 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:48.469813 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:48.469813 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:48.469813 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:48.469813 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:48.470713 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:37:48.470713 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:37:48.470713 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:37:48.470713 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:37:48.470713 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 280/566] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jul 15 20:37:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:37:48.470993 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ef6acf-1490-44a9-a21b-53f30a06456a None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:48.499372 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:48.522616 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98f5284-5b4d-4a45-b200-bf7bb3ebdca5 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:48.555788 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36d2402-bc0a-40dc-b20e-e21c34f2e444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:48.556446 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d2402-bc0a-40dc-b20e-e21c34f2e444 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:48.556731 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d2402-bc0a-40dc-b20e-e21c34f2e444 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:48.557006 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d2402-bc0a-40dc-b20e-e21c34f2e444 None admin] PATH_INFO: `/v3/domains` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:48.557712 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36d2402-bc0a-40dc-b20e-e21c34f2e444 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:48.558016 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36d2402-bc0a-40dc-b20e-e21c34f2e444 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:48.559407 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36d2402-bc0a-40dc-b20e-e21c34f2e444 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:48.572352 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 287/567] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jul 15 20:37:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:48.573165 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36d2402-bc0a-40dc-b20e-e21c34f2e444 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:48.573457 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ef6acf-1490-44a9-a21b-53f30a06456a None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:48.603934 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:48.612768 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae747220-f00c-41d0-9ff7-30e509f94c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:48.613546 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae747220-f00c-41d0-9ff7-30e509f94c59 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:48.613923 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae747220-f00c-41d0-9ff7-30e509f94c59 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:48.614254 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae747220-f00c-41d0-9ff7-30e509f94c59 None admin] PATH_INFO: `/v3/projects` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:48.615045 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae747220-f00c-41d0-9ff7-30e509f94c59 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:48.615366 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae747220-f00c-41d0-9ff7-30e509f94c59 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:48.616808 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae747220-f00c-41d0-9ff7-30e509f94c59 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:48.629506 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 281/568] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jul 15 20:37:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:48.630332 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae747220-f00c-41d0-9ff7-30e509f94c59 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:48.673215 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36d2402-bc0a-40dc-b20e-e21c34f2e444 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:48.706936 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c2cc1c-9de8-4df6-ae3a-5bd727d7140e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:48.707725 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2cc1c-9de8-4df6-ae3a-5bd727d7140e None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:48.708014 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2cc1c-9de8-4df6-ae3a-5bd727d7140e None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:48.708296 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2cc1c-9de8-4df6-ae3a-5bd727d7140e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:48.715443 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c2cc1c-9de8-4df6-ae3a-5bd727d7140e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:48.716904 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c2cc1c-9de8-4df6-ae3a-5bd727d7140e None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:48.722497 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:48.732945 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-93c2cc1c-9de8-4df6-ae3a-5bd727d7140e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 15 20:37:48.732945 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:48.732945 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:48.732945 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:48.732945 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:48.732945 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:48.732945 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:48.732945 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:48.732945 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:48.732945 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:48.732945 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:48.732945 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:48.732945 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 20:37:48.732945 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 20:37:48.732945 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 20:37:48.732945 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 20:37:48.734097 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:48.734097 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:48.734097 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 20:37:48.734097 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:37:48.734097 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 20:37:48.734097 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:37:48.734097 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:48.734097 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:48.734097 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:48.734097 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:48.734097 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:48.734097 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:48.734097 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:48.734097 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:48.734097 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:48.734097 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:48.734097 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:48.734097 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:48.740783 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:48.740783 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:48.740783 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 20:37:48.740783 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 20:37:48.740783 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 20:37:48.740783 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 20:37:48.740783 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 20:37:48.740783 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 20:37:48.740783 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 15 20:37:48.740783 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:37:48.740783 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 288/569] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Jul 15 20:37:48 2022] GET /identity/v3/users/neutron => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:37:48.740783 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c2cc1c-9de8-4df6-ae3a-5bd727d7140e None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:48.741543 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae747220-f00c-41d0-9ff7-30e509f94c59 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:48.776909 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f259c3-929c-479f-a278-0dd69a48142b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:48.777487 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f259c3-929c-479f-a278-0dd69a48142b None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:48.777771 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f259c3-929c-479f-a278-0dd69a48142b None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:48.778049 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f259c3-929c-479f-a278-0dd69a48142b None admin] PATH_INFO: `/v3/domains` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:48.778793 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f259c3-929c-479f-a278-0dd69a48142b None admin] RBAC: Adding query filter params (name=Default) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:48.779108 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f259c3-929c-479f-a278-0dd69a48142b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:48.781086 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f259c3-929c-479f-a278-0dd69a48142b None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:48.792085 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 282/570] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jul 15 20:37:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:48.792841 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f259c3-929c-479f-a278-0dd69a48142b None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:48.835154 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:48.844685 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c2cc1c-9de8-4df6-ae3a-5bd727d7140e None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:48.877757 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf4fcef-217c-463c-8dc0-5c547df0b0c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:48.878571 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf4fcef-217c-463c-8dc0-5c547df0b0c7 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:48.878861 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf4fcef-217c-463c-8dc0-5c547df0b0c7 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:48.879143 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf4fcef-217c-463c-8dc0-5c547df0b0c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:48.885735 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf4fcef-217c-463c-8dc0-5c547df0b0c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:48.887236 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf4fcef-217c-463c-8dc0-5c547df0b0c7 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:48.891965 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f259c3-929c-479f-a278-0dd69a48142b None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:48.901657 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-ecf4fcef-217c-463c-8dc0-5c547df0b0c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:37:48.901657 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:48.901657 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:48.901657 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:48.901657 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:48.901657 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:48.901657 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:48.901657 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:48.901657 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:48.901657 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:48.901657 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:48.901657 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:48.901657 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 20:37:48.901657 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 20:37:48.901657 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 20:37:48.902741 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 20:37:48.902741 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:48.902741 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:48.902741 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:48.902741 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:48.902741 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:48.902741 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:48.902741 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:48.902741 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:48.902741 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:48.902741 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:48.902741 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:48.902741 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:48.902741 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:48.902741 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:48.902741 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:48.902741 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:48.903811 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 20:37:48.903811 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 20:37:48.903811 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 20:37:48.903811 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 20:37:48.903811 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 20:37:48.903811 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 20:37:48.903811 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:37:48.903811 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:37:48.903811 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 289/571] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jul 15 20:37:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:37:48.903811 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf4fcef-217c-463c-8dc0-5c547df0b0c7 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:48.928684 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c08c0d-3856-4ba8-9787-b7b251a10b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:48.929569 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c08c0d-3856-4ba8-9787-b7b251a10b01 None admin] REQUEST_METHOD: `PUT` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:48.929857 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c08c0d-3856-4ba8-9787-b7b251a10b01 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:48.930171 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c08c0d-3856-4ba8-9787-b7b251a10b01 None admin] PATH_INFO: `/v3/projects/0ea017caabac4346a1fc822ddfe3e8c2/users/b3e5296637584004b1888453ab9056c4/roles/5661c06533c14256aa58c232ba9db7cb` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:48.944263 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c08c0d-3856-4ba8-9787-b7b251a10b01 None admin] RBAC: Authorizing `identity:create_grant(project_id=0ea017caabac4346a1fc822ddfe3e8c2, user_id=b3e5296637584004b1888453ab9056c4, role_id=5661c06533c14256aa58c232ba9db7cb)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:48.945974 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c08c0d-3856-4ba8-9787-b7b251a10b01 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:48.954475 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:48.967989 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 283/572] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Jul 15 20:37:48 2022] PUT /identity/v3/projects/0ea017caabac4346a1fc822ddfe3e8c2/users/b3e5296637584004b1888453ab9056c4/roles/5661c06533c14256aa58c232ba9db7cb => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:37:48.967989 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c08c0d-3856-4ba8-9787-b7b251a10b01 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:49.020253 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf4fcef-217c-463c-8dc0-5c547df0b0c7 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:49.063357 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc84330-28d6-4372-aa4e-7db850972b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:49.063963 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc84330-28d6-4372-aa4e-7db850972b75 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:49.064252 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc84330-28d6-4372-aa4e-7db850972b75 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:49.064539 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc84330-28d6-4372-aa4e-7db850972b75 None admin] PATH_INFO: `/v3/users` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:49.065395 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc84330-28d6-4372-aa4e-7db850972b75 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:49.065712 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc84330-28d6-4372-aa4e-7db850972b75 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:49.067208 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc84330-28d6-4372-aa4e-7db850972b75 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:49.087741 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 290/573] 10.222.0.16 () {56 vars in 1139 bytes} [Fri Jul 15 20:37:48 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:49.088768 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc84330-28d6-4372-aa4e-7db850972b75 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:49.100254 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c08c0d-3856-4ba8-9787-b7b251a10b01 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:49.103879 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:49.144989 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba445ad5-b005-4506-8ddb-1babde72de91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:49.147535 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba445ad5-b005-4506-8ddb-1babde72de91 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:49.147535 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba445ad5-b005-4506-8ddb-1babde72de91 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:49.147535 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba445ad5-b005-4506-8ddb-1babde72de91 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:49.157223 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba445ad5-b005-4506-8ddb-1babde72de91 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:49.158726 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba445ad5-b005-4506-8ddb-1babde72de91 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:49.173302 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-ba445ad5-b005-4506-8ddb-1babde72de91 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:37:49.173302 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:49.173302 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:49.173302 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:49.173302 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:49.173302 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:49.173302 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:49.173302 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:49.173302 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:49.173302 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:49.173302 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:49.173302 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:49.173302 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 20:37:49.173302 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 20:37:49.173302 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 20:37:49.174338 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 20:37:49.174338 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:49.174338 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:49.174338 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:49.174338 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:49.174338 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:49.174338 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:49.174338 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:49.174338 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:49.174338 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:49.174338 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:49.174338 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:49.174338 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:49.174338 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:49.174338 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:49.174338 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:49.174338 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:49.175219 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 20:37:49.175219 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 20:37:49.175219 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 20:37:49.175219 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 20:37:49.175219 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 20:37:49.175219 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 20:37:49.175219 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:37:49.175219 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:37:49.175219 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 284/574] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jul 15 20:37:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:37:49.175723 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba445ad5-b005-4506-8ddb-1babde72de91 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:49.204152 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc84330-28d6-4372-aa4e-7db850972b75 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:49.235737 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:49.241527 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1809cadd-6835-4487-9a50-e648dc59aefc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:49.242361 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809cadd-6835-4487-9a50-e648dc59aefc None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:49.242750 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809cadd-6835-4487-9a50-e648dc59aefc None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:49.243132 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809cadd-6835-4487-9a50-e648dc59aefc None admin] PATH_INFO: `/v3/projects` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:49.244135 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1809cadd-6835-4487-9a50-e648dc59aefc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:49.244569 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1809cadd-6835-4487-9a50-e648dc59aefc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:49.246179 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1809cadd-6835-4487-9a50-e648dc59aefc None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:49.262746 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 291/575] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jul 15 20:37:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:49.262746 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1809cadd-6835-4487-9a50-e648dc59aefc None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:49.288624 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba445ad5-b005-4506-8ddb-1babde72de91 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:49.330554 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae8578c-62f5-4bb0-b32e-34f1476b091f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:49.331368 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8578c-62f5-4bb0-b32e-34f1476b091f None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:49.331726 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8578c-62f5-4bb0-b32e-34f1476b091f None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:49.332198 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8578c-62f5-4bb0-b32e-34f1476b091f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:49.340503 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:49.344749 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae8578c-62f5-4bb0-b32e-34f1476b091f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:49.345903 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae8578c-62f5-4bb0-b32e-34f1476b091f None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:49.365008 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-dae8578c-62f5-4bb0-b32e-34f1476b091f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:37:49.365008 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:49.365008 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:49.365008 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:49.365008 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:49.365008 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:49.365008 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:49.365008 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:49.365008 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:49.365008 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:49.365008 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:49.365008 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:49.365008 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:37:49.365008 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:37:49.365008 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:37:49.366149 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:37:49.366149 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:49.366149 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:49.366149 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:49.366149 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:49.366149 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:49.366149 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:49.366149 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:49.366149 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:49.366149 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:49.366149 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:49.366149 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:49.366149 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:49.366149 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:49.366149 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:49.366149 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:49.366149 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:49.371643 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:37:49.371643 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:37:49.371643 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:37:49.371643 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:37:49.371643 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 285/576] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jul 15 20:37:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:37:49.371643 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae8578c-62f5-4bb0-b32e-34f1476b091f None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:49.384244 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1809cadd-6835-4487-9a50-e648dc59aefc None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:49.423220 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ecde28-e9e9-4207-92f8-1144e3aeff4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:49.423888 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ecde28-e9e9-4207-92f8-1144e3aeff4e None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:49.424350 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ecde28-e9e9-4207-92f8-1144e3aeff4e None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:49.424472 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ecde28-e9e9-4207-92f8-1144e3aeff4e None admin] PATH_INFO: `/v3/projects` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:49.425225 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ecde28-e9e9-4207-92f8-1144e3aeff4e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:49.425535 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ecde28-e9e9-4207-92f8-1144e3aeff4e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:49.426999 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ecde28-e9e9-4207-92f8-1144e3aeff4e None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:49.445971 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 292/577] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jul 15 20:37:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:49.445971 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ecde28-e9e9-4207-92f8-1144e3aeff4e None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:49.489497 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae8578c-62f5-4bb0-b32e-34f1476b091f None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:49.502816 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:49.528153 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d693c4c3-0e56-4978-908b-07e6443fe1d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:49.530943 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d693c4c3-0e56-4978-908b-07e6443fe1d1 None admin] REQUEST_METHOD: `PUT` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:49.531231 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d693c4c3-0e56-4978-908b-07e6443fe1d1 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:49.531518 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d693c4c3-0e56-4978-908b-07e6443fe1d1 None admin] PATH_INFO: `/v3/projects/0ea017caabac4346a1fc822ddfe3e8c2/users/2766cf20921045a896ff7735cc2534d6/roles/5661c06533c14256aa58c232ba9db7cb` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:49.547162 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d693c4c3-0e56-4978-908b-07e6443fe1d1 None admin] RBAC: Authorizing `identity:create_grant(project_id=0ea017caabac4346a1fc822ddfe3e8c2, user_id=2766cf20921045a896ff7735cc2534d6, role_id=5661c06533c14256aa58c232ba9db7cb)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:49.549151 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d693c4c3-0e56-4978-908b-07e6443fe1d1 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:49.557953 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ecde28-e9e9-4207-92f8-1144e3aeff4e None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:49.564342 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 286/578] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Jul 15 20:37:49 2022] PUT /identity/v3/projects/0ea017caabac4346a1fc822ddfe3e8c2/users/2766cf20921045a896ff7735cc2534d6/roles/5661c06533c14256aa58c232ba9db7cb => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:37:49.565149 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d693c4c3-0e56-4978-908b-07e6443fe1d1 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:49.593479 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:49.602965 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b555871-519e-4900-a308-c747e789d3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:49.603923 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b555871-519e-4900-a308-c747e789d3a7 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:49.604307 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b555871-519e-4900-a308-c747e789d3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:49.604700 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b555871-519e-4900-a308-c747e789d3a7 None admin] PATH_INFO: `/v3/domains` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:49.605534 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b555871-519e-4900-a308-c747e789d3a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:49.605902 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b555871-519e-4900-a308-c747e789d3a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:49.607665 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b555871-519e-4900-a308-c747e789d3a7 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:49.625980 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 293/579] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jul 15 20:37:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:49.630232 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b555871-519e-4900-a308-c747e789d3a7 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:49.746534 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d693c4c3-0e56-4978-908b-07e6443fe1d1 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:49.756806 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b555871-519e-4900-a308-c747e789d3a7 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:49.791259 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69317c0e-0b54-42d4-a860-c1fdcecd2205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:49.792954 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69317c0e-0b54-42d4-a860-c1fdcecd2205 None admin] REQUEST_METHOD: `PUT` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:49.793767 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69317c0e-0b54-42d4-a860-c1fdcecd2205 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:49.794293 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69317c0e-0b54-42d4-a860-c1fdcecd2205 None admin] PATH_INFO: `/v3/projects/0ea017caabac4346a1fc822ddfe3e8c2/users/d50ee89209d2474b8609861ed0a513e6/roles/5661c06533c14256aa58c232ba9db7cb` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:49.805111 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39c417f-1e7a-4ad1-8189-8b3f01da61e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:49.806263 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39c417f-1e7a-4ad1-8189-8b3f01da61e9 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:49.806808 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39c417f-1e7a-4ad1-8189-8b3f01da61e9 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:49.807303 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39c417f-1e7a-4ad1-8189-8b3f01da61e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:49.811815 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69317c0e-0b54-42d4-a860-c1fdcecd2205 None admin] RBAC: Authorizing `identity:create_grant(project_id=0ea017caabac4346a1fc822ddfe3e8c2, user_id=d50ee89209d2474b8609861ed0a513e6, role_id=5661c06533c14256aa58c232ba9db7cb)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:49.813271 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69317c0e-0b54-42d4-a860-c1fdcecd2205 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:49.816001 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39c417f-1e7a-4ad1-8189-8b3f01da61e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:49.818129 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39c417f-1e7a-4ad1-8189-8b3f01da61e9 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:49.832062 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 287/580] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Jul 15 20:37:49 2022] PUT /identity/v3/projects/0ea017caabac4346a1fc822ddfe3e8c2/users/d50ee89209d2474b8609861ed0a513e6/roles/5661c06533c14256aa58c232ba9db7cb => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:37:49.836931 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-b39c417f-1e7a-4ad1-8189-8b3f01da61e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:37:49.836931 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:49.836931 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:49.836931 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:49.836931 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:49.836931 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:49.836931 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:49.836931 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:49.836931 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:49.836931 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:49.836931 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:49.836931 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:49.836931 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 20:37:49.836931 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 20:37:49.836931 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 20:37:49.837841 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 20:37:49.837841 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:49.837841 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:49.837841 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:49.837841 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:49.837841 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:49.837841 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:49.837841 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:49.837841 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:49.837841 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:49.837841 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:49.837841 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:49.837841 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:49.837841 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:49.837841 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:49.837841 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:49.837841 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:49.838822 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 20:37:49.838822 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 20:37:49.838822 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 20:37:49.838822 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 20:37:49.838822 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 20:37:49.838822 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 20:37:49.838822 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:37:49.838822 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:37:49.841000 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 294/581] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jul 15 20:37:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:37:49.847146 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69317c0e-0b54-42d4-a860-c1fdcecd2205 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:49.876364 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:49.965252 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69317c0e-0b54-42d4-a860-c1fdcecd2205 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:50.003883 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11caa6b7-4145-4e61-b3e4-84f94a71f918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:50.004590 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11caa6b7-4145-4e61-b3e4-84f94a71f918 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:50.004883 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11caa6b7-4145-4e61-b3e4-84f94a71f918 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:50.005164 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11caa6b7-4145-4e61-b3e4-84f94a71f918 None admin] PATH_INFO: `/v3/projects` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:50.005967 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11caa6b7-4145-4e61-b3e4-84f94a71f918 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:50.006316 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11caa6b7-4145-4e61-b3e4-84f94a71f918 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:50.007777 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11caa6b7-4145-4e61-b3e4-84f94a71f918 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:50.021427 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 288/582] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jul 15 20:37:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:37:50.027716 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39c417f-1e7a-4ad1-8189-8b3f01da61e9 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:50.083408 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:50.142936 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39c417f-1e7a-4ad1-8189-8b3f01da61e9 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:50.180049 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c47c372-8ffa-43fe-9449-4629c1250604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:50.180952 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c47c372-8ffa-43fe-9449-4629c1250604 None admin] REQUEST_METHOD: `PUT` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:50.181240 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c47c372-8ffa-43fe-9449-4629c1250604 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:50.181522 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c47c372-8ffa-43fe-9449-4629c1250604 None admin] PATH_INFO: `/v3/projects/0ea017caabac4346a1fc822ddfe3e8c2/users/3491680e892041678242f9b93617b9a6/roles/5661c06533c14256aa58c232ba9db7cb` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:50.197915 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c47c372-8ffa-43fe-9449-4629c1250604 None admin] RBAC: Authorizing `identity:create_grant(project_id=0ea017caabac4346a1fc822ddfe3e8c2, user_id=3491680e892041678242f9b93617b9a6, role_id=5661c06533c14256aa58c232ba9db7cb)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:50.199418 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c47c372-8ffa-43fe-9449-4629c1250604 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:50.213436 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 295/583] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Jul 15 20:37:50 2022] PUT /identity/v3/projects/0ea017caabac4346a1fc822ddfe3e8c2/users/3491680e892041678242f9b93617b9a6/roles/5661c06533c14256aa58c232ba9db7cb => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:37:51.263775 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a45879-5bf4-4360-a295-06911337edd4 None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:51.264893 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a45879-5bf4-4360-a295-06911337edd4 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:51.264893 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a45879-5bf4-4360-a295-06911337edd4 None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:51.266631 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 289/584] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:37:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:37:51.272064 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d289cf-da78-4182-855a-128c5d183c2b None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:51.272469 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d289cf-da78-4182-855a-128c5d183c2b None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:51.272645 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d289cf-da78-4182-855a-128c5d183c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:51.289399 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-78d289cf-da78-4182-855a-128c5d183c2b None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:51.290621 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-78d289cf-da78-4182-855a-128c5d183c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:51.363946 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 296/585] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:37:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:37:51.388925 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a45879-5bf4-4360-a295-06911337edd4 None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:51.476425 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:51.512247 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a45879-5bf4-4360-a295-06911337edd4 None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:51.549163 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e074bed8-67dc-4f85-a18c-938536f9fd3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:51.550365 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074bed8-67dc-4f85-a18c-938536f9fd3d None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:51.550877 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074bed8-67dc-4f85-a18c-938536f9fd3d None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:51.551363 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074bed8-67dc-4f85-a18c-938536f9fd3d None admin] PATH_INFO: `/v3/roles/service` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:51.562961 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e074bed8-67dc-4f85-a18c-938536f9fd3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:37:51.571471 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-e074bed8-67dc-4f85-a18c-938536f9fd3d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 20:37:51.571471 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:51.571471 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:51.571471 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:51.571471 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:51.571471 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:51.571471 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:51.571471 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:51.571471 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:51.571471 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:51.571471 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:51.571471 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:51.571471 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:37:51.571471 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:37:51.571471 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:37:51.571471 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:37:51.572386 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:37:51.572386 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:37:51.572386 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:37:51.572386 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:37:51.572386 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:51.572386 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:51.572386 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:51.572386 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:51.572386 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:51.572386 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:51.572386 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:51.572386 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:51.572386 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:51.572386 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:51.572386 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:51.572386 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:51.573222 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:51.573222 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:51.573222 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:51.573222 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:51.573222 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:37:51.573222 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:37:51.573222 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:37:51.573222 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:37:51.573222 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:37:51.573222 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:37:51.573222 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 20:37:51.573222 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:37:51.576017 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 290/586] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Jul 15 20:37:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:37:51.582577 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d289cf-da78-4182-855a-128c5d183c2b None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:51.617977 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:51.694233 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d289cf-da78-4182-855a-128c5d183c2b None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:51.730021 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a00ff5-dfde-42bf-a5d7-fbdec3889d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:51.730735 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a00ff5-dfde-42bf-a5d7-fbdec3889d0a None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:51.731024 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a00ff5-dfde-42bf-a5d7-fbdec3889d0a None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:51.731309 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a00ff5-dfde-42bf-a5d7-fbdec3889d0a None admin] PATH_INFO: `/v3/roles` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:51.732061 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a00ff5-dfde-42bf-a5d7-fbdec3889d0a None admin] RBAC: Adding query filter params (name=service) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:51.732374 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a00ff5-dfde-42bf-a5d7-fbdec3889d0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:51.734434 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a00ff5-dfde-42bf-a5d7-fbdec3889d0a None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:51.743488 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 297/587] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Jul 15 20:37:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:51.749382 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e074bed8-67dc-4f85-a18c-938536f9fd3d None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:51.862030 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e074bed8-67dc-4f85-a18c-938536f9fd3d None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:51.894067 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:51.898135 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de28beb6-1967-4288-ba1c-b021caac9ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:51.904958 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de28beb6-1967-4288-ba1c-b021caac9ed3 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:51.904958 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de28beb6-1967-4288-ba1c-b021caac9ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:51.904958 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de28beb6-1967-4288-ba1c-b021caac9ed3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:51.911982 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de28beb6-1967-4288-ba1c-b021caac9ed3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:51.913737 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de28beb6-1967-4288-ba1c-b021caac9ed3 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:51.922967 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5580244-82de-4356-a92a-ee7d18b4461b None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:51.923258 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5580244-82de-4356-a92a-ee7d18b4461b None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:51.923546 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5580244-82de-4356-a92a-ee7d18b4461b None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:51.925187 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 298/588] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:37:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:37:51.929988 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ad5db-82b1-4031-a73b-eac174e4c623 None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:51.930319 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ad5db-82b1-4031-a73b-eac174e4c623 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:51.930606 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ad5db-82b1-4031-a73b-eac174e4c623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:51.934989 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-de28beb6-1967-4288-ba1c-b021caac9ed3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:37:51.934989 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:51.934989 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:51.934989 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:51.934989 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:51.934989 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:51.934989 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:51.934989 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:51.934989 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:51.934989 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:51.934989 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:51.934989 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:51.934989 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:37:51.934989 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:37:51.934989 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:37:51.935844 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:37:51.935844 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:51.935844 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:51.935844 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:51.935844 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:51.935844 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:51.935844 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:51.935844 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:51.935844 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:51.935844 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:51.935844 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:51.935844 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:51.935844 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:51.935844 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:51.935844 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:51.935844 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:51.935844 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:51.937293 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:37:51.937293 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:37:51.937293 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:37:51.937293 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:37:51.939233 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 291/589] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jul 15 20:37:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:37:51.947036 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de28beb6-1967-4288-ba1c-b021caac9ed3 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:51.948389 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-9c2ad5db-82b1-4031-a73b-eac174e4c623 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:51.949776 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-9c2ad5db-82b1-4031-a73b-eac174e4c623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:52.039117 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 299/590] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:37:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 20:37:52.065518 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ad5db-82b1-4031-a73b-eac174e4c623 None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:52.067115 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de28beb6-1967-4288-ba1c-b021caac9ed3 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:52.090802 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:52.104381 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fbe70f-d3e5-44da-884f-c3a961fbf8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:52.105076 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fbe70f-d3e5-44da-884f-c3a961fbf8ee None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:52.105436 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fbe70f-d3e5-44da-884f-c3a961fbf8ee None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:52.105635 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fbe70f-d3e5-44da-884f-c3a961fbf8ee None admin] PATH_INFO: `/v3/domains` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:52.106422 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fbe70f-d3e5-44da-884f-c3a961fbf8ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:52.106756 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fbe70f-d3e5-44da-884f-c3a961fbf8ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:52.108785 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fbe70f-d3e5-44da-884f-c3a961fbf8ee None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:52.128369 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 292/591] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jul 15 20:37:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:52.130692 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fbe70f-d3e5-44da-884f-c3a961fbf8ee None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:52.189254 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:52.197919 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ad5db-82b1-4031-a73b-eac174e4c623 None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:52.247648 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f002391-dffb-4ad2-872b-578666d18f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:52.248711 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f002391-dffb-4ad2-872b-578666d18f06 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:52.249215 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f002391-dffb-4ad2-872b-578666d18f06 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:52.249569 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f002391-dffb-4ad2-872b-578666d18f06 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:52.262824 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fbe70f-d3e5-44da-884f-c3a961fbf8ee None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:52.265528 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f002391-dffb-4ad2-872b-578666d18f06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:37:52.273401 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-7f002391-dffb-4ad2-872b-578666d18f06 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 20:37:52.273401 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:52.273401 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:52.273401 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:52.273401 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:52.273401 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:52.273401 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:52.273401 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:52.273401 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:52.273401 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:52.273401 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:52.273401 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:52.273401 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:37:52.273401 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:37:52.273401 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:37:52.273401 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:37:52.278682 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:37:52.278682 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:37:52.278682 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:37:52.278682 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:37:52.278682 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:52.278682 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:52.278682 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:52.278682 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:52.278682 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:52.278682 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:52.278682 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:52.278682 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:52.278682 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:52.278682 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:52.278682 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:52.278682 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:52.279499 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:52.279499 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:52.279499 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:52.279499 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:52.279499 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:37:52.279499 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:37:52.279499 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:37:52.279499 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:37:52.279499 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:37:52.279499 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:37:52.279499 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 20:37:52.279499 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:37:52.279499 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 300/592] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Jul 15 20:37:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 20:37:52.279499 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c03a295-9db7-4b9a-b01e-39fb7f11ea9f None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:52.280791 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c03a295-9db7-4b9a-b01e-39fb7f11ea9f None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:52.280791 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c03a295-9db7-4b9a-b01e-39fb7f11ea9f None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:52.280791 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 301/593] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:37:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:37:52.283175 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c03a295-9db7-4b9a-b01e-39fb7f11ea9f None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:52.304848 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3407249e-7c14-42be-a810-671f463d6687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:52.305640 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407249e-7c14-42be-a810-671f463d6687 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:52.305928 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407249e-7c14-42be-a810-671f463d6687 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:52.306247 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407249e-7c14-42be-a810-671f463d6687 None admin] PATH_INFO: `/v3/users/nova` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:52.313740 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3407249e-7c14-42be-a810-671f463d6687 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:52.315306 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3407249e-7c14-42be-a810-671f463d6687 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:52.330221 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-3407249e-7c14-42be-a810-671f463d6687 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 15 20:37:52.330221 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:52.330221 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:52.330221 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:52.330221 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:52.330221 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:52.330221 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:52.330221 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:52.330221 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:52.330221 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:52.330221 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:52.330221 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:52.330221 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 20:37:52.330221 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 20:37:52.330221 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 20:37:52.330221 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 20:37:52.331186 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:52.331186 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:52.331186 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 20:37:52.331186 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:37:52.331186 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 20:37:52.331186 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:37:52.331186 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:52.331186 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:52.331186 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:52.331186 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:52.331186 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:52.331186 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:52.331186 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:52.331186 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:52.331186 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:52.331186 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:52.331186 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:52.331186 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:52.337456 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:52.337456 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:52.337456 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 20:37:52.337456 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 20:37:52.337456 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 20:37:52.337456 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 20:37:52.337456 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 20:37:52.337456 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 20:37:52.337456 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 15 20:37:52.337456 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:37:52.337456 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 293/594] 10.222.0.16 () {56 vars in 1093 bytes} [Fri Jul 15 20:37:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 20:37:52.337456 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec423652-1b75-4cfc-aa3d-e5e5f23f80fb None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:52.337456 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec423652-1b75-4cfc-aa3d-e5e5f23f80fb None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:52.338245 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec423652-1b75-4cfc-aa3d-e5e5f23f80fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:52.355599 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-ec423652-1b75-4cfc-aa3d-e5e5f23f80fb None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:52.356800 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-ec423652-1b75-4cfc-aa3d-e5e5f23f80fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:52.390026 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:52.413065 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c03a295-9db7-4b9a-b01e-39fb7f11ea9f None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:52.436896 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 294/595] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:37:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:37:52.439944 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec423652-1b75-4cfc-aa3d-e5e5f23f80fb None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:52.460250 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fae4fc3-e827-42aa-add9-52c732b6cd03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:52.460926 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae4fc3-e827-42aa-add9-52c732b6cd03 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:52.461216 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae4fc3-e827-42aa-add9-52c732b6cd03 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:52.461495 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae4fc3-e827-42aa-add9-52c732b6cd03 None admin] PATH_INFO: `/v3/roles` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:52.462272 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fae4fc3-e827-42aa-add9-52c732b6cd03 None admin] RBAC: Adding query filter params (name=service) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:52.462636 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fae4fc3-e827-42aa-add9-52c732b6cd03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:52.463960 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fae4fc3-e827-42aa-add9-52c732b6cd03 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:52.478288 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 302/596] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Jul 15 20:37:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:52.479339 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fae4fc3-e827-42aa-add9-52c732b6cd03 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:52.484910 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:52.557741 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec423652-1b75-4cfc-aa3d-e5e5f23f80fb None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:52.585098 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fae4fc3-e827-42aa-add9-52c732b6cd03 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:52.592226 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3f8625-8601-4810-8449-da7b94f207f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:52.593442 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f8625-8601-4810-8449-da7b94f207f0 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:52.593707 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f8625-8601-4810-8449-da7b94f207f0 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:52.593986 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f8625-8601-4810-8449-da7b94f207f0 None admin] PATH_INFO: `/v3/users` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:52.594853 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3f8625-8601-4810-8449-da7b94f207f0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:52.595169 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3f8625-8601-4810-8449-da7b94f207f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:52.596609 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3f8625-8601-4810-8449-da7b94f207f0 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:52.613457 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 295/597] 10.222.0.16 () {56 vars in 1133 bytes} [Fri Jul 15 20:37:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:52.614520 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3f8625-8601-4810-8449-da7b94f207f0 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:52.630704 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dd66c5-cd88-4454-b5d0-abea179fbdcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:52.631507 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd66c5-cd88-4454-b5d0-abea179fbdcf None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:52.631788 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd66c5-cd88-4454-b5d0-abea179fbdcf None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:52.632060 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd66c5-cd88-4454-b5d0-abea179fbdcf None admin] PATH_INFO: `/v3/roles/service` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:52.642992 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dd66c5-cd88-4454-b5d0-abea179fbdcf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:37:52.650707 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-51dd66c5-cd88-4454-b5d0-abea179fbdcf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 20:37:52.650707 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:52.650707 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:52.650707 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:52.650707 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:52.650707 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:52.650707 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:52.650707 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:52.650707 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:52.650707 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:52.650707 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:52.650707 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:52.650707 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:37:52.650707 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:37:52.650707 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:37:52.650707 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:37:52.651812 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:37:52.651812 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:37:52.651812 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:37:52.651812 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:37:52.651812 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:52.651812 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:52.651812 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:52.651812 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:52.651812 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:52.651812 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:52.651812 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:52.651812 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:52.651812 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:52.651812 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:52.651812 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:52.651812 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:52.652870 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:52.652870 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:52.652870 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:52.652870 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:52.652870 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:37:52.652870 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:37:52.652870 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:37:52.652870 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:37:52.652870 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:37:52.652870 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:37:52.652870 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 20:37:52.652870 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:37:52.652870 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 303/598] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Jul 15 20:37:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:37:52.653707 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee347c-0377-4608-b8f5-9f4ee5904991 None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:52.653707 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee347c-0377-4608-b8f5-9f4ee5904991 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:52.653707 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee347c-0377-4608-b8f5-9f4ee5904991 None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:52.655513 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 304/599] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:37:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:37:52.656192 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceee347c-0377-4608-b8f5-9f4ee5904991 None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:52.660382 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:52.719556 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:52.729376 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3f8625-8601-4810-8449-da7b94f207f0 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:52.756256 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceee347c-0377-4608-b8f5-9f4ee5904991 None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:52.762635 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aacd2c-70f9-4c18-b3d2-4df1467f1fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:52.763494 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aacd2c-70f9-4c18-b3d2-4df1467f1fcc None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:52.763787 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aacd2c-70f9-4c18-b3d2-4df1467f1fcc None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:52.764617 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aacd2c-70f9-4c18-b3d2-4df1467f1fcc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:52.774503 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aacd2c-70f9-4c18-b3d2-4df1467f1fcc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:52.775935 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aacd2c-70f9-4c18-b3d2-4df1467f1fcc None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:52.789245 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c21e5b6-9764-465c-bdb9-825a92d3e4be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:52.789884 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c21e5b6-9764-465c-bdb9-825a92d3e4be None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:52.790204 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c21e5b6-9764-465c-bdb9-825a92d3e4be None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:52.790489 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c21e5b6-9764-465c-bdb9-825a92d3e4be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:52.793449 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-44aacd2c-70f9-4c18-b3d2-4df1467f1fcc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:37:52.793449 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:52.793449 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:52.793449 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:52.793449 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:52.793449 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:52.793449 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:52.793449 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:52.793449 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:52.793449 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:52.793449 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:52.793449 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:52.793449 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:37:52.793449 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:37:52.793449 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:37:52.794529 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:37:52.794529 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:52.794529 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:52.794529 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:52.794529 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:52.794529 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:52.794529 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:52.794529 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:52.794529 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:52.794529 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:52.794529 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:52.794529 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:52.794529 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:52.794529 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:52.794529 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:52.794529 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:52.794529 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:52.795486 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:37:52.795486 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:37:52.795486 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:37:52.795486 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:37:52.795486 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 296/600] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jul 15 20:37:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:37:52.795486 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aacd2c-70f9-4c18-b3d2-4df1467f1fcc None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:52.859708 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c21e5b6-9764-465c-bdb9-825a92d3e4be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:52.861156 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c21e5b6-9764-465c-bdb9-825a92d3e4be None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:52.864460 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:52.899692 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aacd2c-70f9-4c18-b3d2-4df1467f1fcc None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:52.931722 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21293b54-739d-4ee8-acfb-ea5a02edc65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:52.932381 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21293b54-739d-4ee8-acfb-ea5a02edc65c None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:52.932668 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21293b54-739d-4ee8-acfb-ea5a02edc65c None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:52.932946 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21293b54-739d-4ee8-acfb-ea5a02edc65c None admin] PATH_INFO: `/v3/roles` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:52.933681 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21293b54-739d-4ee8-acfb-ea5a02edc65c None admin] RBAC: Adding query filter params (name=service) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:52.933991 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21293b54-739d-4ee8-acfb-ea5a02edc65c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:52.935388 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21293b54-739d-4ee8-acfb-ea5a02edc65c None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:52.943768 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 297/601] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Jul 15 20:37:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:52.945349 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcdd306-8b15-4138-b9df-ac68b597cc41 None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:52.945734 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcdd306-8b15-4138-b9df-ac68b597cc41 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:52.946135 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcdd306-8b15-4138-b9df-ac68b597cc41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:52.952623 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:52.962359 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 305/602] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jul 15 20:37:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:52.963197 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c21e5b6-9764-465c-bdb9-825a92d3e4be None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:52.963685 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-5fcdd306-8b15-4138-b9df-ac68b597cc41 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:52.964807 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-5fcdd306-8b15-4138-b9df-ac68b597cc41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:53.030362 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 298/603] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:37:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:37:53.031475 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcdd306-8b15-4138-b9df-ac68b597cc41 None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:53.059760 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c21e5b6-9764-465c-bdb9-825a92d3e4be None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:53.062655 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:53.095524 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92b7731-177a-4607-8219-0efbf54c4cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:53.096176 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b7731-177a-4607-8219-0efbf54c4cef None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:53.096459 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b7731-177a-4607-8219-0efbf54c4cef None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:53.096734 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b7731-177a-4607-8219-0efbf54c4cef None admin] PATH_INFO: `/v3/domains` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:53.097441 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92b7731-177a-4607-8219-0efbf54c4cef None admin] RBAC: Adding query filter params (name=Default) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:53.097744 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92b7731-177a-4607-8219-0efbf54c4cef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:53.099148 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92b7731-177a-4607-8219-0efbf54c4cef None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:53.110752 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 306/604] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jul 15 20:37:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:53.111345 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92b7731-177a-4607-8219-0efbf54c4cef None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:53.145665 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcdd306-8b15-4138-b9df-ac68b597cc41 None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:53.178729 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165ba1a2-f04d-41a9-aef5-58ca5f8a7c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:53.179510 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ba1a2-f04d-41a9-aef5-58ca5f8a7c03 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:53.179798 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ba1a2-f04d-41a9-aef5-58ca5f8a7c03 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:53.180078 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ba1a2-f04d-41a9-aef5-58ca5f8a7c03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:53.181975 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:53.191749 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165ba1a2-f04d-41a9-aef5-58ca5f8a7c03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:53.193321 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165ba1a2-f04d-41a9-aef5-58ca5f8a7c03 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:53.211035 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-165ba1a2-f04d-41a9-aef5-58ca5f8a7c03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:37:53.211035 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:53.211035 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:53.211035 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:53.211035 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:53.211035 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:53.211035 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:53.211035 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:53.211035 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:53.211035 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:53.211035 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:53.211035 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:53.211035 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:37:53.211035 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:37:53.211035 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:37:53.212079 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:37:53.212079 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:53.212079 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:53.212079 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:53.212079 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:53.212079 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:53.212079 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:53.212079 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:53.212079 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:53.212079 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:53.212079 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:53.212079 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:53.212079 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:53.212079 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:53.212079 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:53.212079 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:53.212079 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:53.217794 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:37:53.217794 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:37:53.217794 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:37:53.217794 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:37:53.217794 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 299/605] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jul 15 20:37:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:37:53.218177 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92b7731-177a-4607-8219-0efbf54c4cef None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:53.218275 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165ba1a2-f04d-41a9-aef5-58ca5f8a7c03 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:53.250572 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e57f24-a85b-4553-bae9-c37953233e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:53.251360 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e57f24-a85b-4553-bae9-c37953233e20 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:53.251648 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e57f24-a85b-4553-bae9-c37953233e20 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:53.251925 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e57f24-a85b-4553-bae9-c37953233e20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:53.262277 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e57f24-a85b-4553-bae9-c37953233e20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:53.263709 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e57f24-a85b-4553-bae9-c37953233e20 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:53.280198 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-d1e57f24-a85b-4553-bae9-c37953233e20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:37:53.280198 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:53.280198 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:53.280198 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:53.280198 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:53.280198 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:53.280198 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:53.280198 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:53.280198 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:53.280198 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:53.280198 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:53.280198 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:53.280198 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:37:53.280198 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:37:53.280198 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:37:53.281596 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:37:53.281596 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:53.281596 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:53.281596 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:53.281596 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:53.281596 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:53.281596 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:53.281596 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:53.281596 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:53.281596 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:53.281596 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:53.281596 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:53.281596 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:53.281596 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:53.281596 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:53.281596 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:53.281596 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:53.282507 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:37:53.282507 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:37:53.282507 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:37:53.282507 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:37:53.282507 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 307/606] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jul 15 20:37:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:37:53.282507 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e57f24-a85b-4553-bae9-c37953233e20 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:53.300148 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:53.317693 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165ba1a2-f04d-41a9-aef5-58ca5f8a7c03 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:53.350485 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1932f0-8334-4156-9ae8-2e60ed5df6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:53.351267 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1932f0-8334-4156-9ae8-2e60ed5df6f7 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:53.351561 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1932f0-8334-4156-9ae8-2e60ed5df6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:53.351840 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1932f0-8334-4156-9ae8-2e60ed5df6f7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:53.364103 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1932f0-8334-4156-9ae8-2e60ed5df6f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:37:53.371883 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-7e1932f0-8334-4156-9ae8-2e60ed5df6f7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 20:37:53.371883 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:53.371883 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:53.371883 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:53.371883 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:53.371883 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:53.371883 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:53.371883 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:53.371883 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:53.371883 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:53.371883 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:53.371883 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:53.371883 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:37:53.371883 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:37:53.371883 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:37:53.371883 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:37:53.373007 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:37:53.373007 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:37:53.373007 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:37:53.373007 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:37:53.373007 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:53.373007 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:53.373007 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:53.373007 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:53.373007 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:53.373007 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:53.373007 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:53.373007 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:53.373007 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:53.373007 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:53.373007 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:53.373007 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:53.379426 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:53.379426 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:53.379426 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:53.379426 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:53.379426 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:37:53.379426 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:37:53.379426 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:37:53.379426 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:37:53.379426 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:37:53.379426 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:37:53.379426 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 20:37:53.379426 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:37:53.379426 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 300/607] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Jul 15 20:37:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:37:53.379426 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1932f0-8334-4156-9ae8-2e60ed5df6f7 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:53.387945 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e57f24-a85b-4553-bae9-c37953233e20 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:53.419313 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:53.421149 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5616ec-499e-42b3-9835-01b81aaa4a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:53.421970 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5616ec-499e-42b3-9835-01b81aaa4a90 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:53.422287 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5616ec-499e-42b3-9835-01b81aaa4a90 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:53.422610 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5616ec-499e-42b3-9835-01b81aaa4a90 None admin] PATH_INFO: `/v3/users/glance` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:53.430215 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5616ec-499e-42b3-9835-01b81aaa4a90 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:53.431605 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5616ec-499e-42b3-9835-01b81aaa4a90 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:53.446487 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-aa5616ec-499e-42b3-9835-01b81aaa4a90 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 15 20:37:53.446487 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:53.446487 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:53.446487 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:53.446487 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:53.446487 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:53.446487 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:53.446487 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:53.446487 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:53.446487 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:53.446487 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:53.446487 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:53.446487 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 20:37:53.446487 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 20:37:53.446487 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 20:37:53.446487 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 20:37:53.447438 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:53.447438 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:53.447438 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 20:37:53.447438 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:37:53.447438 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 20:37:53.447438 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:37:53.447438 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:53.447438 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:53.447438 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:53.447438 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:53.447438 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:53.447438 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:53.447438 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:53.447438 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:53.447438 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:53.447438 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:53.447438 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:53.447438 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:53.448617 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:53.448617 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:53.448617 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 20:37:53.448617 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 20:37:53.448617 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 20:37:53.448617 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 20:37:53.448617 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 20:37:53.448617 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 20:37:53.448617 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 15 20:37:53.448617 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:37:53.448617 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 308/608] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jul 15 20:37:53 2022] GET /identity/v3/users/glance => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:37:53.448617 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5616ec-499e-42b3-9835-01b81aaa4a90 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:53.480378 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1932f0-8334-4156-9ae8-2e60ed5df6f7 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:53.529147 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0310300c-d90c-4951-8377-abddc6f9d772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:53.530374 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0310300c-d90c-4951-8377-abddc6f9d772 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:53.530668 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0310300c-d90c-4951-8377-abddc6f9d772 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:53.530950 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0310300c-d90c-4951-8377-abddc6f9d772 None admin] PATH_INFO: `/v3/domains` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:53.531677 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0310300c-d90c-4951-8377-abddc6f9d772 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:53.531990 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0310300c-d90c-4951-8377-abddc6f9d772 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:53.532687 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:53.533521 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0310300c-d90c-4951-8377-abddc6f9d772 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:53.546801 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 301/609] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jul 15 20:37:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:53.547626 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0310300c-d90c-4951-8377-abddc6f9d772 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:53.556186 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5616ec-499e-42b3-9835-01b81aaa4a90 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:53.589667 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60223a02-19ef-40e0-b78a-b00155579490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:53.590401 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60223a02-19ef-40e0-b78a-b00155579490 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:53.590690 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60223a02-19ef-40e0-b78a-b00155579490 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:53.590968 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60223a02-19ef-40e0-b78a-b00155579490 None admin] PATH_INFO: `/v3/domains` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:53.591686 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60223a02-19ef-40e0-b78a-b00155579490 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:53.591994 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60223a02-19ef-40e0-b78a-b00155579490 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:53.593862 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60223a02-19ef-40e0-b78a-b00155579490 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:53.605788 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 309/610] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jul 15 20:37:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:53.606611 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60223a02-19ef-40e0-b78a-b00155579490 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:53.652638 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0310300c-d90c-4951-8377-abddc6f9d772 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:53.660338 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:53.687126 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68a5b2d-b53c-4caa-8804-e8ad0757eddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:53.687719 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a5b2d-b53c-4caa-8804-e8ad0757eddb None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:53.688004 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a5b2d-b53c-4caa-8804-e8ad0757eddb None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:53.688283 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a5b2d-b53c-4caa-8804-e8ad0757eddb None admin] PATH_INFO: `/v3/roles` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:53.689017 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68a5b2d-b53c-4caa-8804-e8ad0757eddb None admin] RBAC: Adding query filter params (name=service) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:53.689324 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68a5b2d-b53c-4caa-8804-e8ad0757eddb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:53.690728 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68a5b2d-b53c-4caa-8804-e8ad0757eddb None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:53.698705 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 302/611] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Jul 15 20:37:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:53.699483 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68a5b2d-b53c-4caa-8804-e8ad0757eddb None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:53.705357 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60223a02-19ef-40e0-b78a-b00155579490 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:53.741565 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f989bc21-3109-494c-95f5-d131add75f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:53.742315 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f989bc21-3109-494c-95f5-d131add75f5e None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:53.742605 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f989bc21-3109-494c-95f5-d131add75f5e None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:53.742912 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f989bc21-3109-494c-95f5-d131add75f5e None admin] PATH_INFO: `/v3/users` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:53.743739 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f989bc21-3109-494c-95f5-d131add75f5e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:53.744051 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f989bc21-3109-494c-95f5-d131add75f5e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:53.745489 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f989bc21-3109-494c-95f5-d131add75f5e None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:53.748968 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:53.763339 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 310/612] 10.222.0.16 () {56 vars in 1137 bytes} [Fri Jul 15 20:37:53 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:53.764168 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f989bc21-3109-494c-95f5-d131add75f5e None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:53.798557 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68a5b2d-b53c-4caa-8804-e8ad0757eddb None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:53.832690 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670fb191-6b86-4eb3-a49a-e73b8ff65bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:53.833468 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670fb191-6b86-4eb3-a49a-e73b8ff65bbc None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:53.833760 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670fb191-6b86-4eb3-a49a-e73b8ff65bbc None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:53.834036 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670fb191-6b86-4eb3-a49a-e73b8ff65bbc None admin] PATH_INFO: `/v3/users/cinder` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:53.841366 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670fb191-6b86-4eb3-a49a-e73b8ff65bbc None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:53.843405 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670fb191-6b86-4eb3-a49a-e73b8ff65bbc None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:53.857818 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-670fb191-6b86-4eb3-a49a-e73b8ff65bbc None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 15 20:37:53.857818 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:53.857818 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:53.857818 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:53.857818 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:53.857818 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:53.857818 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:53.857818 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:53.857818 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:53.857818 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:53.857818 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:53.857818 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:53.857818 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 20:37:53.857818 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 20:37:53.857818 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 20:37:53.857818 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 20:37:53.859447 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:53.859447 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:53.859447 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 20:37:53.859447 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:37:53.859447 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 20:37:53.859447 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:37:53.859447 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:53.859447 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:53.859447 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:53.859447 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:53.859447 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:53.859447 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:53.859447 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:53.859447 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:53.859447 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:53.859447 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:53.859447 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:53.859447 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:53.860643 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:53.860643 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:53.860643 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 20:37:53.860643 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 20:37:53.860643 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 20:37:53.860643 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 20:37:53.860643 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 20:37:53.860643 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 20:37:53.860643 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 15 20:37:53.860643 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:37:53.860643 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 303/613] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jul 15 20:37:53 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:37:53.860643 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670fb191-6b86-4eb3-a49a-e73b8ff65bbc None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:53.867694 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f989bc21-3109-494c-95f5-d131add75f5e None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:53.887831 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:53.901278 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4ee346-c22f-4176-9294-80a6e328cdd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:53.902065 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ee346-c22f-4176-9294-80a6e328cdd4 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:53.902399 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ee346-c22f-4176-9294-80a6e328cdd4 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:53.902681 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ee346-c22f-4176-9294-80a6e328cdd4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:53.909794 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4ee346-c22f-4176-9294-80a6e328cdd4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:53.911259 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4ee346-c22f-4176-9294-80a6e328cdd4 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:53.924733 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-3a4ee346-c22f-4176-9294-80a6e328cdd4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:37:53.924733 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:53.924733 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:53.924733 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:53.924733 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:53.924733 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:53.924733 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:53.924733 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:53.924733 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:53.924733 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:53.924733 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:53.924733 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:53.924733 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 20:37:53.924733 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 20:37:53.924733 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 20:37:53.925634 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 20:37:53.925634 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:53.925634 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:53.925634 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:53.925634 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:53.925634 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:53.925634 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:53.925634 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:53.925634 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:53.925634 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:53.925634 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:53.925634 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:53.925634 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:53.925634 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:53.925634 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:53.925634 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:53.925634 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:53.926743 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 20:37:53.926743 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 20:37:53.926743 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 20:37:53.926743 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 20:37:53.926743 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 20:37:53.926743 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 20:37:53.926743 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:37:53.926743 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:37:53.926743 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 311/614] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jul 15 20:37:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:37:53.926743 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4ee346-c22f-4176-9294-80a6e328cdd4 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:53.960715 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670fb191-6b86-4eb3-a49a-e73b8ff65bbc None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:53.981007 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:53.993876 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e79ad58-ec8f-456a-b0b4-49038be4df72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:53.994698 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e79ad58-ec8f-456a-b0b4-49038be4df72 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:53.994988 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e79ad58-ec8f-456a-b0b4-49038be4df72 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:53.995269 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e79ad58-ec8f-456a-b0b4-49038be4df72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:54.005704 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e79ad58-ec8f-456a-b0b4-49038be4df72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:54.007184 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e79ad58-ec8f-456a-b0b4-49038be4df72 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:54.024818 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-1e79ad58-ec8f-456a-b0b4-49038be4df72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:37:54.024818 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:54.024818 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:54.024818 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:54.024818 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:54.024818 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:54.024818 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:54.024818 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:54.024818 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:54.024818 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:54.024818 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:54.024818 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:54.024818 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:37:54.024818 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:37:54.024818 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:37:54.025720 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:37:54.025720 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:54.025720 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:54.025720 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:54.025720 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:54.025720 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:54.025720 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:54.025720 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:54.025720 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:54.025720 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:54.025720 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:54.025720 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:54.025720 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:54.025720 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:54.025720 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:54.025720 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:54.025720 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:54.026637 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:37:54.026637 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:37:54.026637 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:37:54.026637 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:37:54.026637 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 304/615] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jul 15 20:37:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:37:54.026905 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4ee346-c22f-4176-9294-80a6e328cdd4 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:54.027378 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e79ad58-ec8f-456a-b0b4-49038be4df72 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:54.063066 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edfa403-ac50-4665-a5f9-bdaec1141a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:54.063720 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edfa403-ac50-4665-a5f9-bdaec1141a36 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:54.064010 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edfa403-ac50-4665-a5f9-bdaec1141a36 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:54.064293 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edfa403-ac50-4665-a5f9-bdaec1141a36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:54.107297 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:54.125941 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e79ad58-ec8f-456a-b0b4-49038be4df72 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:54.129865 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edfa403-ac50-4665-a5f9-bdaec1141a36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:54.131366 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edfa403-ac50-4665-a5f9-bdaec1141a36 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:54.160101 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9558e774-5fa8-43f8-8667-3d28afcfcb4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:54.160757 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9558e774-5fa8-43f8-8667-3d28afcfcb4e None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:54.161038 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9558e774-5fa8-43f8-8667-3d28afcfcb4e None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:54.161328 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9558e774-5fa8-43f8-8667-3d28afcfcb4e None admin] PATH_INFO: `/v3/users` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:54.162181 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9558e774-5fa8-43f8-8667-3d28afcfcb4e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:54.162499 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9558e774-5fa8-43f8-8667-3d28afcfcb4e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:54.163926 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9558e774-5fa8-43f8-8667-3d28afcfcb4e None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:54.180386 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 305/616] 10.222.0.16 () {56 vars in 1137 bytes} [Fri Jul 15 20:37:54 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:54.181197 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9558e774-5fa8-43f8-8667-3d28afcfcb4e None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:54.184377 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:54.229988 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 312/617] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jul 15 20:37:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:54.230780 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edfa403-ac50-4665-a5f9-bdaec1141a36 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:54.287985 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9558e774-5fa8-43f8-8667-3d28afcfcb4e None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:54.322869 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ffa81f-1930-4647-8550-c5f694da7032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:54.323656 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ffa81f-1930-4647-8550-c5f694da7032 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:54.323959 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ffa81f-1930-4647-8550-c5f694da7032 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:54.324233 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ffa81f-1930-4647-8550-c5f694da7032 None admin] PATH_INFO: `/v3/projects` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:54.325013 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ffa81f-1930-4647-8550-c5f694da7032 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:54.325362 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ffa81f-1930-4647-8550-c5f694da7032 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:54.327397 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ffa81f-1930-4647-8550-c5f694da7032 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:54.331744 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edfa403-ac50-4665-a5f9-bdaec1141a36 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:54.334811 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:54.340194 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 306/618] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jul 15 20:37:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:54.341062 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ffa81f-1930-4647-8550-c5f694da7032 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:54.368267 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246622e1-a2fd-450e-a1fc-d579b9f7014e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:54.368925 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246622e1-a2fd-450e-a1fc-d579b9f7014e None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:54.369207 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246622e1-a2fd-450e-a1fc-d579b9f7014e None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:54.369480 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246622e1-a2fd-450e-a1fc-d579b9f7014e None admin] PATH_INFO: `/v3/domains` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:54.370235 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246622e1-a2fd-450e-a1fc-d579b9f7014e None admin] RBAC: Adding query filter params (name=Default) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:54.370546 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246622e1-a2fd-450e-a1fc-d579b9f7014e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:54.371895 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246622e1-a2fd-450e-a1fc-d579b9f7014e None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:54.384554 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 313/619] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jul 15 20:37:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:54.385165 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246622e1-a2fd-450e-a1fc-d579b9f7014e None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:54.400598 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:54.445661 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ffa81f-1930-4647-8550-c5f694da7032 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:54.480651 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c1076-1bb5-4cdc-a962-c06712c25060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:54.481243 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c1076-1bb5-4cdc-a962-c06712c25060 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:54.481534 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c1076-1bb5-4cdc-a962-c06712c25060 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:54.481816 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c1076-1bb5-4cdc-a962-c06712c25060 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:54.494709 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246622e1-a2fd-450e-a1fc-d579b9f7014e None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:54.528202 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045eee9d-7e5a-48fd-8e2f-d9825376b7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:54.528996 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045eee9d-7e5a-48fd-8e2f-d9825376b7a8 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:54.529282 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045eee9d-7e5a-48fd-8e2f-d9825376b7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:54.529585 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045eee9d-7e5a-48fd-8e2f-d9825376b7a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:54.545156 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045eee9d-7e5a-48fd-8e2f-d9825376b7a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:54.547069 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:54.547260 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045eee9d-7e5a-48fd-8e2f-d9825376b7a8 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:54.551105 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5c1076-1bb5-4cdc-a962-c06712c25060 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:54.552841 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5c1076-1bb5-4cdc-a962-c06712c25060 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:54.565143 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-045eee9d-7e5a-48fd-8e2f-d9825376b7a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:37:54.565143 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:54.565143 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:54.565143 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:54.565143 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:54.565143 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:54.565143 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:54.565143 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:54.565143 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:54.565143 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:54.565143 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:54.565143 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:54.565143 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:37:54.565143 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:37:54.565143 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:37:54.566021 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:37:54.566021 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:54.566021 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:54.566021 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:54.566021 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:54.566021 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:54.566021 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:54.566021 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:54.566021 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:54.566021 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:54.566021 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:54.566021 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:54.566021 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:54.566021 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:54.566021 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:54.566021 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:54.566021 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:54.567114 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:37:54.567114 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:37:54.567114 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:37:54.567114 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:37:54.567114 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 314/620] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jul 15 20:37:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:37:54.567114 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045eee9d-7e5a-48fd-8e2f-d9825376b7a8 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:54.641538 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:54.660016 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 307/621] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jul 15 20:37:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:54.660858 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c1076-1bb5-4cdc-a962-c06712c25060 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:54.677784 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045eee9d-7e5a-48fd-8e2f-d9825376b7a8 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:54.710929 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6f41bb-0077-4692-a4b2-549a28bc43ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:54.711584 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f41bb-0077-4692-a4b2-549a28bc43ad None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:54.711873 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f41bb-0077-4692-a4b2-549a28bc43ad None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:54.712156 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f41bb-0077-4692-a4b2-549a28bc43ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:54.712986 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6f41bb-0077-4692-a4b2-549a28bc43ad None admin] RBAC: Adding query filter params (role.id=5661c06533c14256aa58c232ba9db7cb, scope.project.id=0ea017caabac4346a1fc822ddfe3e8c2, user.id=b3e5296637584004b1888453ab9056c4) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:54.713305 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6f41bb-0077-4692-a4b2-549a28bc43ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:54.714898 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6f41bb-0077-4692-a4b2-549a28bc43ad None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:54.721411 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 315/622] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jul 15 20:37:54 2022] GET /identity/v3/role_assignments?user.id=b3e5296637584004b1888453ab9056c4&scope.project.id=0ea017caabac4346a1fc822ddfe3e8c2&role.id=5661c06533c14256aa58c232ba9db7cb => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:54.722214 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6f41bb-0077-4692-a4b2-549a28bc43ad None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:54.760343 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:54.765257 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c1076-1bb5-4cdc-a962-c06712c25060 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:54.807827 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc3ee1-30a7-46fd-8fbe-27ee746a78c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:54.809241 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc3ee1-30a7-46fd-8fbe-27ee746a78c9 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:54.809688 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc3ee1-30a7-46fd-8fbe-27ee746a78c9 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:54.810017 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc3ee1-30a7-46fd-8fbe-27ee746a78c9 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:54.818801 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fc3ee1-30a7-46fd-8fbe-27ee746a78c9 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:54.820529 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fc3ee1-30a7-46fd-8fbe-27ee746a78c9 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:54.836548 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-c1fc3ee1-30a7-46fd-8fbe-27ee746a78c9 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 15 20:37:54.836548 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:54.836548 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:54.836548 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:54.836548 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:54.836548 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:54.836548 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:54.836548 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:54.836548 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:54.836548 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:54.836548 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:54.836548 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:54.836548 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 20:37:54.836548 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 20:37:54.836548 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 20:37:54.836548 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 20:37:54.837572 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:54.837572 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:54.837572 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 20:37:54.837572 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:37:54.837572 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 20:37:54.837572 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:37:54.837572 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:54.837572 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:54.837572 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:54.837572 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:54.837572 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:54.837572 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:54.837572 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:54.837572 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:54.837572 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:54.837572 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:54.837572 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:54.837572 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:54.838519 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:54.838519 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:54.838519 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 20:37:54.838519 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 20:37:54.838519 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 20:37:54.838519 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 20:37:54.838519 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 20:37:54.838519 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 20:37:54.838519 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 15 20:37:54.838519 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:37:54.838519 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 308/623] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Jul 15 20:37:54 2022] GET /identity/v3/users/neutron => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:37:54.839115 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc3ee1-30a7-46fd-8fbe-27ee746a78c9 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:54.851596 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6f41bb-0077-4692-a4b2-549a28bc43ad None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:54.884521 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:54.892940 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1910b6f-75c3-45f4-9ac1-e60fa31e81e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:54.893140 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1910b6f-75c3-45f4-9ac1-e60fa31e81e2 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:54.893322 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1910b6f-75c3-45f4-9ac1-e60fa31e81e2 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:54.893605 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1910b6f-75c3-45f4-9ac1-e60fa31e81e2 None admin] PATH_INFO: `/v3/domains` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:54.894433 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1910b6f-75c3-45f4-9ac1-e60fa31e81e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:54.894675 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1910b6f-75c3-45f4-9ac1-e60fa31e81e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:54.896046 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1910b6f-75c3-45f4-9ac1-e60fa31e81e2 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:54.911456 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 316/624] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jul 15 20:37:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:54.912866 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1910b6f-75c3-45f4-9ac1-e60fa31e81e2 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:54.963938 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc3ee1-30a7-46fd-8fbe-27ee746a78c9 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:55.005389 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16e1af5-9710-46bc-9826-f9d5bf2c159e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:55.006218 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16e1af5-9710-46bc-9826-f9d5bf2c159e None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:55.006503 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16e1af5-9710-46bc-9826-f9d5bf2c159e None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:55.006779 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16e1af5-9710-46bc-9826-f9d5bf2c159e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:55.018408 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16e1af5-9710-46bc-9826-f9d5bf2c159e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:55.019805 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16e1af5-9710-46bc-9826-f9d5bf2c159e None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:55.024587 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1910b6f-75c3-45f4-9ac1-e60fa31e81e2 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:55.038009 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-b16e1af5-9710-46bc-9826-f9d5bf2c159e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:37:55.038009 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:55.038009 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:55.038009 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:55.038009 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:55.038009 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:55.038009 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:55.038009 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:55.038009 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:55.038009 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:55.038009 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:55.038009 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:55.038009 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:37:55.038009 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:37:55.038009 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:37:55.038969 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:37:55.038969 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:55.038969 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:55.038969 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:55.038969 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:55.038969 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:55.038969 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:55.038969 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:55.038969 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:55.038969 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:55.038969 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:55.038969 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:55.038969 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:55.038969 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:55.038969 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:55.038969 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:55.038969 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:55.039857 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:37:55.039857 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:37:55.039857 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:37:55.039857 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:37:55.039857 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 309/625] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jul 15 20:37:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:37:55.040140 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16e1af5-9710-46bc-9826-f9d5bf2c159e None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:55.055292 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:55.068417 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcafaf8-ccb5-491f-8ad3-78826934209a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:55.069089 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcafaf8-ccb5-491f-8ad3-78826934209a None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:55.069382 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcafaf8-ccb5-491f-8ad3-78826934209a None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:55.069927 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcafaf8-ccb5-491f-8ad3-78826934209a None admin] PATH_INFO: `/v3/users` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:55.070795 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcafaf8-ccb5-491f-8ad3-78826934209a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:55.071107 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcafaf8-ccb5-491f-8ad3-78826934209a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:55.072529 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcafaf8-ccb5-491f-8ad3-78826934209a None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:55.090648 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 317/626] 10.222.0.16 () {56 vars in 1139 bytes} [Fri Jul 15 20:37:54 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:55.091789 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcafaf8-ccb5-491f-8ad3-78826934209a None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:55.143759 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:55.155951 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16e1af5-9710-46bc-9826-f9d5bf2c159e None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:55.192569 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d275ca3-b930-4392-b455-dfa5ae377086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:55.193405 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d275ca3-b930-4392-b455-dfa5ae377086 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:55.193679 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d275ca3-b930-4392-b455-dfa5ae377086 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:55.193960 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d275ca3-b930-4392-b455-dfa5ae377086 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:55.195170 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcafaf8-ccb5-491f-8ad3-78826934209a None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:55.200975 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d275ca3-b930-4392-b455-dfa5ae377086 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:55.202499 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d275ca3-b930-4392-b455-dfa5ae377086 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:55.216726 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-3d275ca3-b930-4392-b455-dfa5ae377086 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:37:55.216726 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:55.216726 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:55.216726 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:55.216726 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:55.216726 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:55.216726 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:55.216726 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:55.216726 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:55.216726 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:55.216726 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:55.216726 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:55.216726 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 20:37:55.216726 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 20:37:55.216726 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 20:37:55.218361 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 20:37:55.218361 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:55.218361 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:55.218361 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:55.218361 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:55.218361 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:55.218361 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:55.218361 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:55.218361 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:55.218361 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:55.218361 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:55.218361 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:55.218361 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:55.218361 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:55.218361 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:55.218361 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:55.218361 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:55.219235 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 20:37:55.219235 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 20:37:55.219235 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 20:37:55.219235 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 20:37:55.219235 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 20:37:55.219235 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 20:37:55.219235 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:37:55.219235 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:37:55.219235 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 310/627] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jul 15 20:37:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:37:55.219724 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d275ca3-b930-4392-b455-dfa5ae377086 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:55.235972 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c68d68-19ae-4cd0-a111-f859168b98fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:55.236902 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c68d68-19ae-4cd0-a111-f859168b98fb None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:55.237328 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c68d68-19ae-4cd0-a111-f859168b98fb None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:55.237755 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c68d68-19ae-4cd0-a111-f859168b98fb None admin] PATH_INFO: `/v3/domains` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:55.238643 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c68d68-19ae-4cd0-a111-f859168b98fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:55.238952 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c68d68-19ae-4cd0-a111-f859168b98fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:55.240311 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c68d68-19ae-4cd0-a111-f859168b98fb None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:55.257885 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 318/628] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jul 15 20:37:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:55.257885 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c68d68-19ae-4cd0-a111-f859168b98fb None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:55.303884 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:55.338139 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d275ca3-b930-4392-b455-dfa5ae377086 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:55.366780 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c68d68-19ae-4cd0-a111-f859168b98fb None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:55.372381 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c109ad-1dfa-478e-9b5e-f8afbba240cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:55.373029 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c109ad-1dfa-478e-9b5e-f8afbba240cd None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:55.373433 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c109ad-1dfa-478e-9b5e-f8afbba240cd None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:55.373627 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c109ad-1dfa-478e-9b5e-f8afbba240cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:55.377663 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:55.408688 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837bfe47-a113-4614-bd72-260a03b829a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:55.409348 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837bfe47-a113-4614-bd72-260a03b829a4 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:55.409642 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837bfe47-a113-4614-bd72-260a03b829a4 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:55.409907 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837bfe47-a113-4614-bd72-260a03b829a4 None admin] PATH_INFO: `/v3/projects` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:55.410798 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837bfe47-a113-4614-bd72-260a03b829a4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:55.411023 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837bfe47-a113-4614-bd72-260a03b829a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:55.412466 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837bfe47-a113-4614-bd72-260a03b829a4 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:55.427140 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 319/629] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jul 15 20:37:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:55.427966 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837bfe47-a113-4614-bd72-260a03b829a4 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:55.463211 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c109ad-1dfa-478e-9b5e-f8afbba240cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:55.465269 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c109ad-1dfa-478e-9b5e-f8afbba240cd None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:55.539923 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837bfe47-a113-4614-bd72-260a03b829a4 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:55.548216 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:55.579492 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e211fe-563e-41a7-a3be-7c82c1470267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:55.580625 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e211fe-563e-41a7-a3be-7c82c1470267 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:55.580918 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e211fe-563e-41a7-a3be-7c82c1470267 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:55.581196 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e211fe-563e-41a7-a3be-7c82c1470267 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:55.586215 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 311/630] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jul 15 20:37:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:55.587382 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c109ad-1dfa-478e-9b5e-f8afbba240cd None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:55.592653 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e211fe-563e-41a7-a3be-7c82c1470267 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:55.594141 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e211fe-563e-41a7-a3be-7c82c1470267 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:55.608475 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-c6e211fe-563e-41a7-a3be-7c82c1470267 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:37:55.608475 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:55.608475 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:55.608475 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:55.608475 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:55.608475 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:55.608475 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:55.608475 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:55.608475 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:55.608475 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:55.608475 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:55.608475 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:55.608475 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 20:37:55.608475 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 20:37:55.608475 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 20:37:55.609339 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 20:37:55.609339 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:55.609339 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:55.609339 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:55.609339 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:55.609339 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:55.609339 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:55.609339 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:55.609339 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:55.609339 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:55.609339 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:55.609339 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:55.609339 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:55.609339 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:55.609339 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:55.609339 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:55.609339 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:55.611033 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 20:37:55.611033 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 20:37:55.611033 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 20:37:55.611033 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 20:37:55.611033 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 20:37:55.611033 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 20:37:55.611033 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:37:55.611033 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:37:55.611033 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 320/631] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jul 15 20:37:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:37:55.611033 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e211fe-563e-41a7-a3be-7c82c1470267 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:55.644348 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:55.705255 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c109ad-1dfa-478e-9b5e-f8afbba240cd None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:55.721800 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e211fe-563e-41a7-a3be-7c82c1470267 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:55.739875 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc38290-7c3b-4672-8d2e-4f44e1d4cbf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:55.740596 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc38290-7c3b-4672-8d2e-4f44e1d4cbf4 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:55.740887 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc38290-7c3b-4672-8d2e-4f44e1d4cbf4 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:55.741164 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc38290-7c3b-4672-8d2e-4f44e1d4cbf4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:55.742002 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc38290-7c3b-4672-8d2e-4f44e1d4cbf4 None admin] RBAC: Adding query filter params (role.id=5661c06533c14256aa58c232ba9db7cb, scope.project.id=0ea017caabac4346a1fc822ddfe3e8c2, user.id=2766cf20921045a896ff7735cc2534d6) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:55.742358 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc38290-7c3b-4672-8d2e-4f44e1d4cbf4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:55.743777 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc38290-7c3b-4672-8d2e-4f44e1d4cbf4 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:55.750171 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 312/632] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jul 15 20:37:55 2022] GET /identity/v3/role_assignments?user.id=2766cf20921045a896ff7735cc2534d6&scope.project.id=0ea017caabac4346a1fc822ddfe3e8c2&role.id=5661c06533c14256aa58c232ba9db7cb => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:55.751033 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc38290-7c3b-4672-8d2e-4f44e1d4cbf4 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:55.770187 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e2f37-93eb-4c5e-b564-1077d047d789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:55.772153 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e2f37-93eb-4c5e-b564-1077d047d789 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:55.772629 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e2f37-93eb-4c5e-b564-1077d047d789 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:55.773080 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e2f37-93eb-4c5e-b564-1077d047d789 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:55.789982 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:55.790501 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60e2f37-93eb-4c5e-b564-1077d047d789 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:55.793835 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60e2f37-93eb-4c5e-b564-1077d047d789 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:55.815765 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-d60e2f37-93eb-4c5e-b564-1077d047d789 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:37:55.815765 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:55.815765 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:55.815765 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:55.815765 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:55.815765 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:55.815765 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:55.815765 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:55.815765 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:55.815765 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:55.815765 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:55.815765 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:55.815765 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:37:55.815765 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:37:55.815765 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:37:55.816725 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:37:55.816725 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:55.816725 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:55.816725 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:55.816725 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:55.816725 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:55.816725 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:55.816725 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:55.816725 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:55.816725 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:55.816725 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:55.816725 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:55.816725 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:55.816725 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:55.816725 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:55.816725 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:55.816725 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:55.817632 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:37:55.817632 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:37:55.817632 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:37:55.817632 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:37:55.817632 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 321/633] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jul 15 20:37:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:37:55.827696 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e2f37-93eb-4c5e-b564-1077d047d789 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:55.885069 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc38290-7c3b-4672-8d2e-4f44e1d4cbf4 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:55.939327 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb51687-0da2-4a92-990e-f690cabf3e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:55.940409 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb51687-0da2-4a92-990e-f690cabf3e4d None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:55.940901 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb51687-0da2-4a92-990e-f690cabf3e4d None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:55.941388 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb51687-0da2-4a92-990e-f690cabf3e4d None admin] PATH_INFO: `/v3/projects` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:55.942507 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb51687-0da2-4a92-990e-f690cabf3e4d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:55.943066 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb51687-0da2-4a92-990e-f690cabf3e4d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:55.945199 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:55.945352 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb51687-0da2-4a92-990e-f690cabf3e4d None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:55.960129 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 313/634] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jul 15 20:37:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:55.965767 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb51687-0da2-4a92-990e-f690cabf3e4d None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:55.966266 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e2f37-93eb-4c5e-b564-1077d047d789 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:56.010805 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c669e7-78ed-4435-bd81-015029dc20d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:56.011825 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c669e7-78ed-4435-bd81-015029dc20d0 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:56.011935 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c669e7-78ed-4435-bd81-015029dc20d0 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:56.012211 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c669e7-78ed-4435-bd81-015029dc20d0 None admin] PATH_INFO: `/v3/domains` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:56.013011 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c669e7-78ed-4435-bd81-015029dc20d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:56.013335 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c669e7-78ed-4435-bd81-015029dc20d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:56.014815 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c669e7-78ed-4435-bd81-015029dc20d0 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:56.028185 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 322/635] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jul 15 20:37:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:37:56.034044 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c669e7-78ed-4435-bd81-015029dc20d0 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:56.095011 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:56.104253 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb51687-0da2-4a92-990e-f690cabf3e4d None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:56.147962 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c669e7-78ed-4435-bd81-015029dc20d0 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:56.148794 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b34aedf-a78f-40e3-bd1b-1cf9929bf30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:56.149870 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b34aedf-a78f-40e3-bd1b-1cf9929bf30e None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:56.151160 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b34aedf-a78f-40e3-bd1b-1cf9929bf30e None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:56.151593 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b34aedf-a78f-40e3-bd1b-1cf9929bf30e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:56.152590 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b34aedf-a78f-40e3-bd1b-1cf9929bf30e None admin] RBAC: Adding query filter params (role.id=5661c06533c14256aa58c232ba9db7cb, scope.project.id=0ea017caabac4346a1fc822ddfe3e8c2, user.id=d50ee89209d2474b8609861ed0a513e6) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:56.153050 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b34aedf-a78f-40e3-bd1b-1cf9929bf30e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:56.155329 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b34aedf-a78f-40e3-bd1b-1cf9929bf30e None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:56.164263 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 314/636] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jul 15 20:37:55 2022] GET /identity/v3/role_assignments?user.id=d50ee89209d2474b8609861ed0a513e6&scope.project.id=0ea017caabac4346a1fc822ddfe3e8c2&role.id=5661c06533c14256aa58c232ba9db7cb => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:37:56.194160 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e49907-ff7c-475f-96e0-8b2652af9f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:56.195384 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e49907-ff7c-475f-96e0-8b2652af9f08 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:56.195671 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e49907-ff7c-475f-96e0-8b2652af9f08 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:56.195946 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e49907-ff7c-475f-96e0-8b2652af9f08 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:56.204910 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e49907-ff7c-475f-96e0-8b2652af9f08 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:56.206550 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e49907-ff7c-475f-96e0-8b2652af9f08 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:56.209611 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:56.224282 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-85e49907-ff7c-475f-96e0-8b2652af9f08 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:37:56.224282 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:56.224282 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:56.224282 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:56.224282 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:56.224282 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:56.224282 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:56.224282 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:56.224282 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:56.224282 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:56.224282 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:56.224282 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:56.224282 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 20:37:56.224282 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 20:37:56.224282 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 20:37:56.225425 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 20:37:56.225425 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:56.225425 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:56.225425 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:56.225425 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:56.225425 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:56.225425 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:56.225425 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:56.225425 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:56.225425 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:56.225425 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:56.225425 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:56.225425 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:56.225425 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:56.225425 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:56.225425 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:56.225425 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:56.226642 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 20:37:56.226642 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 20:37:56.226642 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 20:37:56.226642 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 20:37:56.226642 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 20:37:56.226642 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 20:37:56.226642 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:37:56.226642 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:37:56.226642 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 323/637] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jul 15 20:37:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 20:37:56.233719 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b34aedf-a78f-40e3-bd1b-1cf9929bf30e None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:56.347214 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b34aedf-a78f-40e3-bd1b-1cf9929bf30e None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:56.386335 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34f8d22-014e-4b3d-aaa1-ec5a3a56f55a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:56.387383 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f8d22-014e-4b3d-aaa1-ec5a3a56f55a None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:56.387873 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f8d22-014e-4b3d-aaa1-ec5a3a56f55a None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:56.388348 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f8d22-014e-4b3d-aaa1-ec5a3a56f55a None admin] PATH_INFO: `/v3/projects` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:56.389388 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34f8d22-014e-4b3d-aaa1-ec5a3a56f55a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:56.389913 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34f8d22-014e-4b3d-aaa1-ec5a3a56f55a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:56.391609 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34f8d22-014e-4b3d-aaa1-ec5a3a56f55a None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:56.405140 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 315/638] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jul 15 20:37:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:56.410853 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e49907-ff7c-475f-96e0-8b2652af9f08 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:56.525448 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e49907-ff7c-475f-96e0-8b2652af9f08 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:56.561847 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358f282b-d82a-4a69-8c64-4fcb86fa347a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:56.562585 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f282b-d82a-4a69-8c64-4fcb86fa347a None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:56.562875 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f282b-d82a-4a69-8c64-4fcb86fa347a None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:56.563200 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f282b-d82a-4a69-8c64-4fcb86fa347a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:56.564031 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358f282b-d82a-4a69-8c64-4fcb86fa347a None admin] RBAC: Adding query filter params (role.id=5661c06533c14256aa58c232ba9db7cb, scope.project.id=0ea017caabac4346a1fc822ddfe3e8c2, user.id=3491680e892041678242f9b93617b9a6) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:56.564344 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358f282b-d82a-4a69-8c64-4fcb86fa347a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:56.565775 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358f282b-d82a-4a69-8c64-4fcb86fa347a None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:56.576156 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 324/639] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jul 15 20:37:56 2022] GET /identity/v3/role_assignments?user.id=3491680e892041678242f9b93617b9a6&scope.project.id=0ea017caabac4346a1fc822ddfe3e8c2&role.id=5661c06533c14256aa58c232ba9db7cb => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:37:57.109137 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f40ae-bf70-446c-829f-d1dc0e934fec None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:57.109511 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f40ae-bf70-446c-829f-d1dc0e934fec None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:57.109720 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f40ae-bf70-446c-829f-d1dc0e934fec None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:57.111293 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 316/640] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:37:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:37:57.116546 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ad0d4-e216-483b-9e4f-9ae64d789f73 None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:57.116889 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ad0d4-e216-483b-9e4f-9ae64d789f73 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:57.117177 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ad0d4-e216-483b-9e4f-9ae64d789f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:57.134314 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-4a8ad0d4-e216-483b-9e4f-9ae64d789f73 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:57.135487 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-4a8ad0d4-e216-483b-9e4f-9ae64d789f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:57.196294 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:57.206261 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 325/641] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:37:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:37:57.230589 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9f40ae-bf70-446c-829f-d1dc0e934fec None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:57.250896 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:57.340481 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9f40ae-bf70-446c-829f-d1dc0e934fec None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:57.375904 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ea1645-cfb3-4175-860e-5d651884cf95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:57.376619 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea1645-cfb3-4175-860e-5d651884cf95 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:57.376906 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea1645-cfb3-4175-860e-5d651884cf95 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:57.377194 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea1645-cfb3-4175-860e-5d651884cf95 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:57.389576 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ea1645-cfb3-4175-860e-5d651884cf95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:37:57.397185 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-98ea1645-cfb3-4175-860e-5d651884cf95 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:37:57.397185 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:57.397185 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:57.397185 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:57.397185 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:57.397185 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:57.397185 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:57.397185 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:57.397185 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:57.397185 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:57.397185 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:57.397185 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:57.397185 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:37:57.397185 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:37:57.397185 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:37:57.397185 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:37:57.398219 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:37:57.398219 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:37:57.398219 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:37:57.398219 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:37:57.398219 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:57.398219 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:57.398219 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:57.398219 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:57.398219 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:57.398219 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:57.398219 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:57.398219 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:57.398219 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:57.398219 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:57.398219 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:57.398219 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:57.399132 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:57.399132 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:57.399132 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:57.399132 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:57.399132 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:37:57.399132 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:37:57.399132 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:37:57.399132 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:37:57.399132 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:37:57.399132 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:37:57.399132 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:37:57.399132 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:37:57.399132 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 317/642] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Jul 15 20:37:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:37:57.407420 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8ad0d4-e216-483b-9e4f-9ae64d789f73 None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:57.521960 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8ad0d4-e216-483b-9e4f-9ae64d789f73 None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:57.557424 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d265971-837f-4f76-931f-9304ce3df63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:57.558476 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d265971-837f-4f76-931f-9304ce3df63a None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:57.558965 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d265971-837f-4f76-931f-9304ce3df63a None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:57.559441 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d265971-837f-4f76-931f-9304ce3df63a None admin] PATH_INFO: `/v3/roles` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:57.560403 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d265971-837f-4f76-931f-9304ce3df63a None admin] RBAC: Adding query filter params (name=admin) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:57.561446 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d265971-837f-4f76-931f-9304ce3df63a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:57.563031 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d265971-837f-4f76-931f-9304ce3df63a None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:57.572205 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 326/643] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jul 15 20:37:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:57.579142 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ea1645-cfb3-4175-860e-5d651884cf95 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:57.664256 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:57.688158 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ea1645-cfb3-4175-860e-5d651884cf95 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:57.728022 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b9545-6417-4c58-ace5-d57f323c3509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:57.728814 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b9545-6417-4c58-ace5-d57f323c3509 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:57.729097 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b9545-6417-4c58-ace5-d57f323c3509 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:57.729371 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b9545-6417-4c58-ace5-d57f323c3509 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:57.740509 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90b9545-6417-4c58-ace5-d57f323c3509 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:57.741967 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90b9545-6417-4c58-ace5-d57f323c3509 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:57.759548 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-d90b9545-6417-4c58-ace5-d57f323c3509 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:37:57.759548 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:57.759548 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:57.759548 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:57.759548 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:57.759548 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:57.759548 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:57.759548 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:57.759548 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:57.759548 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:57.759548 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:57.759548 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:57.759548 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:37:57.759548 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:37:57.759548 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:37:57.760432 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:37:57.760432 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:57.760432 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:57.760432 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:57.760432 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:57.760432 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:57.760432 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:57.760432 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:57.760432 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:57.760432 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:57.760432 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:57.760432 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:57.760432 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:57.760432 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:57.760432 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:57.760432 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:57.760432 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:57.761282 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:37:57.761282 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:37:57.761282 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:37:57.761282 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:37:57.761282 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 318/644] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jul 15 20:37:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:37:57.768278 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d265971-837f-4f76-931f-9304ce3df63a None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:57.825687 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:57.873610 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d265971-837f-4f76-931f-9304ce3df63a None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:57.908675 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041e2f43-2893-43ab-914b-358597ee8cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:57.909768 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041e2f43-2893-43ab-914b-358597ee8cc2 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:57.910272 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041e2f43-2893-43ab-914b-358597ee8cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:57.910745 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041e2f43-2893-43ab-914b-358597ee8cc2 None admin] PATH_INFO: `/v3/domains` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:57.912979 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041e2f43-2893-43ab-914b-358597ee8cc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:57.913495 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041e2f43-2893-43ab-914b-358597ee8cc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:57.915159 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041e2f43-2893-43ab-914b-358597ee8cc2 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:57.927943 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 327/645] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jul 15 20:37:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:57.933648 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b9545-6417-4c58-ace5-d57f323c3509 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:58.042056 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b9545-6417-4c58-ace5-d57f323c3509 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:58.075179 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:58.082014 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8245ff49-0bf9-4f49-895e-ee5cb061bd7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:58.082837 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8245ff49-0bf9-4f49-895e-ee5cb061bd7f None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:58.083124 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8245ff49-0bf9-4f49-895e-ee5cb061bd7f None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:58.083405 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8245ff49-0bf9-4f49-895e-ee5cb061bd7f None admin] PATH_INFO: `/v3/users/nova` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:58.091640 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8245ff49-0bf9-4f49-895e-ee5cb061bd7f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:58.093128 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8245ff49-0bf9-4f49-895e-ee5cb061bd7f None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:58.107666 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-8245ff49-0bf9-4f49-895e-ee5cb061bd7f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 15 20:37:58.107666 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:58.107666 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:58.107666 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:58.107666 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:58.107666 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:58.107666 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:58.107666 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:58.107666 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:58.107666 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:58.107666 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:58.107666 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:58.107666 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 20:37:58.107666 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 20:37:58.107666 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 20:37:58.107666 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 20:37:58.108581 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:58.108581 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:58.108581 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 20:37:58.108581 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:37:58.108581 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 20:37:58.108581 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:37:58.108581 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:58.108581 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:58.108581 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:58.108581 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:58.108581 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:58.108581 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:58.108581 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:58.108581 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:58.108581 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:58.108581 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:58.108581 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:58.108581 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:58.109482 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:58.109482 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:58.109482 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 20:37:58.109482 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 20:37:58.109482 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 20:37:58.109482 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 20:37:58.109482 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 20:37:58.109482 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 20:37:58.109482 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 15 20:37:58.109482 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:37:58.109482 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 319/646] 10.222.0.16 () {56 vars in 1093 bytes} [Fri Jul 15 20:37:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:37:58.116431 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041e2f43-2893-43ab-914b-358597ee8cc2 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:58.194439 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189448b5-b943-40bb-9c6b-f08454b8db62 None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:58.195039 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189448b5-b943-40bb-9c6b-f08454b8db62 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:58.195267 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189448b5-b943-40bb-9c6b-f08454b8db62 None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:58.196851 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 320/647] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:37:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 20:37:58.202269 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0e71c-0227-4e29-9019-1c3e60ff25ef None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:58.202559 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0e71c-0227-4e29-9019-1c3e60ff25ef None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:58.202838 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0e71c-0227-4e29-9019-1c3e60ff25ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:58.220712 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-eca0e71c-0227-4e29-9019-1c3e60ff25ef None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:58.221921 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-eca0e71c-0227-4e29-9019-1c3e60ff25ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:58.222392 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041e2f43-2893-43ab-914b-358597ee8cc2 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:58.240181 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:58.261026 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67075fc-7776-4197-83b7-fcc9c94c4e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:58.261896 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67075fc-7776-4197-83b7-fcc9c94c4e67 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:58.262308 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67075fc-7776-4197-83b7-fcc9c94c4e67 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:58.262949 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67075fc-7776-4197-83b7-fcc9c94c4e67 None admin] PATH_INFO: `/v3/users` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:58.265618 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67075fc-7776-4197-83b7-fcc9c94c4e67 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:58.265937 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67075fc-7776-4197-83b7-fcc9c94c4e67 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:58.267544 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67075fc-7776-4197-83b7-fcc9c94c4e67 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:58.295294 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 328/648] 10.222.0.16 () {56 vars in 1133 bytes} [Fri Jul 15 20:37:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:58.300959 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67075fc-7776-4197-83b7-fcc9c94c4e67 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:58.309211 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 321/649] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:37:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:37:58.334816 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca0e71c-0227-4e29-9019-1c3e60ff25ef None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:58.417984 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67075fc-7776-4197-83b7-fcc9c94c4e67 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:58.465988 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca0e71c-0227-4e29-9019-1c3e60ff25ef None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:58.471362 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ef4cc5-f144-4d2c-8dcc-9033f7d1bcfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:58.475763 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef4cc5-f144-4d2c-8dcc-9033f7d1bcfb None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:58.476102 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef4cc5-f144-4d2c-8dcc-9033f7d1bcfb None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:58.476333 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef4cc5-f144-4d2c-8dcc-9033f7d1bcfb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:58.504023 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:58.520721 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37cfff7-3b85-4ce7-9163-c2c24f5f702f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:58.521868 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37cfff7-3b85-4ce7-9163-c2c24f5f702f None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:58.522390 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37cfff7-3b85-4ce7-9163-c2c24f5f702f None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:58.522883 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37cfff7-3b85-4ce7-9163-c2c24f5f702f None admin] PATH_INFO: `/v3/services/image` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:58.523725 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37cfff7-3b85-4ce7-9163-c2c24f5f702f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:58.525451 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37cfff7-3b85-4ce7-9163-c2c24f5f702f None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:58.536542 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:58.540934 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-a37cfff7-3b85-4ce7-9163-c2c24f5f702f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 15 20:37:58.540934 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:58.540934 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 20:37:58.540934 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 20:37:58.540934 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 20:37:58.540934 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 20:37:58.540934 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 20:37:58.540934 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:37:58.540934 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 15 20:37:58.540934 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:37:58.540934 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 20:37:58.540934 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:37:58.540934 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:58.540934 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:58.540934 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:58.540934 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:58.540934 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:58.542914 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:58.542914 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:58.542914 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:58.542914 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:58.542914 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:58.542914 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:58.542914 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 20:37:58.542914 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 20:37:58.542914 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 20:37:58.542914 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 20:37:58.542914 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:58.542914 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:58.542914 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:58.542914 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:58.542914 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:58.542914 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:58.543740 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:58.543740 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:58.543740 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:58.543740 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:58.543740 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:58.543740 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:58.543740 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:58.543740 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:58.543740 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:58.543740 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:58.543740 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 20:37:58.543740 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:37:58.543740 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 15 20:37:58.543740 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:37:58.546191 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 322/650] 10.222.0.16 () {56 vars in 1105 bytes} [Fri Jul 15 20:37:58 2022] GET /identity/v3/services/image => generated 86 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 20:37:58.551916 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37cfff7-3b85-4ce7-9163-c2c24f5f702f None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:58.568864 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ef4cc5-f144-4d2c-8dcc-9033f7d1bcfb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:58.571123 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ef4cc5-f144-4d2c-8dcc-9033f7d1bcfb None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:58.680800 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 329/651] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jul 15 20:37:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 15 20:37:58.682116 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37cfff7-3b85-4ce7-9163-c2c24f5f702f None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:58.682229 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a4d1b4-2062-42cd-9ea0-a48fe34d7c99 None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:58.682458 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a4d1b4-2062-42cd-9ea0-a48fe34d7c99 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:58.682741 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a4d1b4-2062-42cd-9ea0-a48fe34d7c99 None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:58.684274 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 330/652] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:37:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:37:58.686065 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a4d1b4-2062-42cd-9ea0-a48fe34d7c99 None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:58.726711 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca3699e-eaa1-440c-a72e-558f34d2cb21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:58.727290 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca3699e-eaa1-440c-a72e-558f34d2cb21 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:58.727584 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca3699e-eaa1-440c-a72e-558f34d2cb21 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:58.727866 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca3699e-eaa1-440c-a72e-558f34d2cb21 None admin] PATH_INFO: `/v3/services` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:58.728882 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca3699e-eaa1-440c-a72e-558f34d2cb21 None admin] RBAC: Adding query filter params (name=image) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:58.728882 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca3699e-eaa1-440c-a72e-558f34d2cb21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:58.730284 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca3699e-eaa1-440c-a72e-558f34d2cb21 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:58.740032 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 323/653] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jul 15 20:37:58 2022] GET /identity/v3/services?name=image => generated 122 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:37:58.740032 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5fb71-0bad-4f65-872f-3ed619fcb9dc None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:58.740032 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5fb71-0bad-4f65-872f-3ed619fcb9dc None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:58.740032 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5fb71-0bad-4f65-872f-3ed619fcb9dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:58.754870 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-4bb5fb71-0bad-4f65-872f-3ed619fcb9dc None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:58.756068 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-4bb5fb71-0bad-4f65-872f-3ed619fcb9dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:58.776739 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:58.805069 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a4d1b4-2062-42cd-9ea0-a48fe34d7c99 None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:58.806291 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:58.831211 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 324/654] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:37:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:37:58.839256 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb5fb71-0bad-4f65-872f-3ed619fcb9dc None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:58.841411 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406ba5ca-428a-40f8-bf56-481e85d97904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:58.842854 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ba5ca-428a-40f8-bf56-481e85d97904 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:58.843143 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ba5ca-428a-40f8-bf56-481e85d97904 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:58.843443 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ba5ca-428a-40f8-bf56-481e85d97904 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:58.856913 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406ba5ca-428a-40f8-bf56-481e85d97904 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:58.859595 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406ba5ca-428a-40f8-bf56-481e85d97904 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:58.880760 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-406ba5ca-428a-40f8-bf56-481e85d97904 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:37:58.880760 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:58.880760 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:58.880760 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:58.880760 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:58.880760 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:58.880760 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:58.880760 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:58.880760 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:58.880760 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:58.880760 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:58.880760 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:58.880760 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:37:58.880760 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:37:58.880760 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:37:58.881724 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:37:58.881724 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:58.881724 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:58.881724 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:58.881724 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:58.881724 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:58.881724 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:58.881724 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:58.881724 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:58.881724 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:58.881724 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:58.881724 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:58.881724 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:58.881724 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:58.881724 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:58.881724 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:58.881724 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:58.883934 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:37:58.883934 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:37:58.883934 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:37:58.883934 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:37:58.883934 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 331/655] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jul 15 20:37:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 20:37:58.883934 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406ba5ca-428a-40f8-bf56-481e85d97904 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:58.955415 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb5fb71-0bad-4f65-872f-3ed619fcb9dc None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:58.992616 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36f7d74-cbe7-4a36-8ddd-714249c2339d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:58.993229 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406ba5ca-428a-40f8-bf56-481e85d97904 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:58.993342 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f7d74-cbe7-4a36-8ddd-714249c2339d None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:58.993583 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f7d74-cbe7-4a36-8ddd-714249c2339d None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:58.993868 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f7d74-cbe7-4a36-8ddd-714249c2339d None admin] PATH_INFO: `/v3/services` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:58.994620 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36f7d74-cbe7-4a36-8ddd-714249c2339d None admin] RBAC: Adding query filter params (type=image) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:58.994938 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36f7d74-cbe7-4a36-8ddd-714249c2339d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:58.996317 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36f7d74-cbe7-4a36-8ddd-714249c2339d None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:59.002104 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 325/656] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jul 15 20:37:58 2022] GET /identity/v3/services?type=image => generated 122 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:59.002898 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36f7d74-cbe7-4a36-8ddd-714249c2339d None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:59.031650 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:59.043239 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ad7dc8-6b84-4c53-aae1-28339a0969f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:59.044102 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad7dc8-6b84-4c53-aae1-28339a0969f1 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:59.044388 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad7dc8-6b84-4c53-aae1-28339a0969f1 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:59.044672 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad7dc8-6b84-4c53-aae1-28339a0969f1 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:59.045923 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ad7dc8-6b84-4c53-aae1-28339a0969f1 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:59.047788 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ad7dc8-6b84-4c53-aae1-28339a0969f1 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:59.062817 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-18ad7dc8-6b84-4c53-aae1-28339a0969f1 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 15 20:37:59.062817 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:59.062817 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 20:37:59.062817 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 20:37:59.062817 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 20:37:59.062817 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 20:37:59.062817 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 20:37:59.062817 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:37:59.062817 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 15 20:37:59.062817 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:37:59.062817 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 20:37:59.062817 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:37:59.062817 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:59.062817 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:59.062817 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:59.062817 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:59.063842 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:59.063842 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:59.063842 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:59.063842 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:59.063842 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:59.063842 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:59.063842 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:59.063842 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 20:37:59.063842 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 20:37:59.063842 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 20:37:59.063842 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 20:37:59.063842 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:59.063842 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:59.063842 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:59.063842 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:59.063842 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:59.065369 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:59.065369 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:59.065369 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:59.065369 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:59.065369 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:59.065369 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:59.065369 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:59.065369 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:59.065369 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:59.065369 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:59.065369 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:59.065369 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 20:37:59.065369 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:37:59.065369 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 15 20:37:59.065369 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:37:59.065369 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 332/657] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jul 15 20:37:58 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:37:59.066437 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a00c2d-2429-45a4-83d4-b80a340ce010 None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:59.066437 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a00c2d-2429-45a4-83d4-b80a340ce010 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:59.066576 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a00c2d-2429-45a4-83d4-b80a340ce010 None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:59.072671 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 333/658] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:37:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:37:59.072671 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a00c2d-2429-45a4-83d4-b80a340ce010 None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:59.183033 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:59.187666 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a00c2d-2429-45a4-83d4-b80a340ce010 None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:59.232463 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e016e88-b463-4b0e-b088-46bb60cc9bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:59.233166 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e016e88-b463-4b0e-b088-46bb60cc9bac None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:59.233451 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e016e88-b463-4b0e-b088-46bb60cc9bac None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:59.233728 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e016e88-b463-4b0e-b088-46bb60cc9bac None admin] PATH_INFO: `/v3/services` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:59.234475 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e016e88-b463-4b0e-b088-46bb60cc9bac None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:59.234790 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e016e88-b463-4b0e-b088-46bb60cc9bac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:59.236180 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e016e88-b463-4b0e-b088-46bb60cc9bac None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:59.240991 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 334/659] 10.222.0.16 () {56 vars in 1124 bytes} [Fri Jul 15 20:37:59 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:59.242577 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f9b354-d3d1-44e6-bb0f-d2feaf5da10e None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:59.242577 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f9b354-d3d1-44e6-bb0f-d2feaf5da10e None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:59.242812 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f9b354-d3d1-44e6-bb0f-d2feaf5da10e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:59.249793 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36f7d74-cbe7-4a36-8ddd-714249c2339d None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:59.262218 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-73f9b354-d3d1-44e6-bb0f-d2feaf5da10e None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:59.263427 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-73f9b354-d3d1-44e6-bb0f-d2feaf5da10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:59.286753 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75830dd7-2835-4952-95af-ac3d847a9d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:59.287417 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75830dd7-2835-4952-95af-ac3d847a9d2c None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:59.287800 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75830dd7-2835-4952-95af-ac3d847a9d2c None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:59.288076 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75830dd7-2835-4952-95af-ac3d847a9d2c None admin] PATH_INFO: `/v3/domains` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:59.288796 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75830dd7-2835-4952-95af-ac3d847a9d2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:59.289103 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75830dd7-2835-4952-95af-ac3d847a9d2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:59.290494 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75830dd7-2835-4952-95af-ac3d847a9d2c None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:59.309633 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 326/660] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jul 15 20:37:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:59.309633 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75830dd7-2835-4952-95af-ac3d847a9d2c None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:59.318220 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:59.338869 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 335/661] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:37:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:37:59.339532 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f9b354-d3d1-44e6-bb0f-d2feaf5da10e None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:59.440135 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75830dd7-2835-4952-95af-ac3d847a9d2c None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:59.441673 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:59.447367 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f9b354-d3d1-44e6-bb0f-d2feaf5da10e None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:59.480248 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3ae486-dcfe-49b2-9a51-38d6fb8e63e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:59.480944 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ae486-dcfe-49b2-9a51-38d6fb8e63e0 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:59.481201 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ae486-dcfe-49b2-9a51-38d6fb8e63e0 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:59.481478 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ae486-dcfe-49b2-9a51-38d6fb8e63e0 None admin] PATH_INFO: `/v3/services` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:59.482219 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3ae486-dcfe-49b2-9a51-38d6fb8e63e0 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:59.482532 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3ae486-dcfe-49b2-9a51-38d6fb8e63e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:59.483916 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3ae486-dcfe-49b2-9a51-38d6fb8e63e0 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:59.498717 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 327/662] 10.222.0.16 () {56 vars in 1124 bytes} [Fri Jul 15 20:37:59 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:59.498717 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3ae486-dcfe-49b2-9a51-38d6fb8e63e0 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:59.502013 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512e4427-8948-454e-ad97-e763e42e105f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:59.502955 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512e4427-8948-454e-ad97-e763e42e105f None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:59.503313 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512e4427-8948-454e-ad97-e763e42e105f None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:59.504552 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512e4427-8948-454e-ad97-e763e42e105f None admin] PATH_INFO: `/v3/projects/service` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:59.516852 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512e4427-8948-454e-ad97-e763e42e105f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:59.518381 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512e4427-8948-454e-ad97-e763e42e105f None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:59.536987 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-512e4427-8948-454e-ad97-e763e42e105f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:37:59.536987 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:59.536987 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:59.536987 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:59.536987 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:59.536987 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:59.536987 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:59.536987 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:59.536987 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:59.536987 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:59.536987 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:59.536987 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:59.536987 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 20:37:59.536987 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 20:37:59.536987 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 20:37:59.538525 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 20:37:59.538525 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:59.538525 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:59.538525 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:59.538525 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:59.538525 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:59.538525 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:59.538525 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:59.538525 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:59.538525 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:59.538525 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:59.538525 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:59.538525 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:59.538525 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:59.538525 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:59.538525 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:59.538525 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:59.539446 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 20:37:59.539446 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 20:37:59.539446 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 20:37:59.539446 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 20:37:59.539446 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 20:37:59.539446 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 20:37:59.539446 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:37:59.539446 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:37:59.539446 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 336/663] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jul 15 20:37:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:37:59.546202 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512e4427-8948-454e-ad97-e763e42e105f None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:59.615087 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:59.624030 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3ae486-dcfe-49b2-9a51-38d6fb8e63e0 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:59.661899 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f813a3-6477-41eb-a4d0-4b743b2243fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:59.662764 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f813a3-6477-41eb-a4d0-4b743b2243fc None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:59.663052 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f813a3-6477-41eb-a4d0-4b743b2243fc None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:59.663330 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f813a3-6477-41eb-a4d0-4b743b2243fc None admin] PATH_INFO: `/v3/services/network` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:59.663986 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f813a3-6477-41eb-a4d0-4b743b2243fc None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:59.665383 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f813a3-6477-41eb-a4d0-4b743b2243fc None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:59.678115 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-b2f813a3-6477-41eb-a4d0-4b743b2243fc None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 15 20:37:59.678115 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:59.678115 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 20:37:59.678115 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 20:37:59.678115 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 20:37:59.678115 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 20:37:59.678115 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 20:37:59.678115 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:37:59.678115 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 15 20:37:59.678115 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:37:59.678115 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 20:37:59.678115 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:37:59.678115 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:37:59.678115 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:37:59.678115 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:37:59.678115 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:37:59.678115 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:37:59.680214 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:37:59.680214 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:37:59.680214 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:37:59.680214 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:37:59.680214 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:37:59.680214 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:37:59.680214 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 20:37:59.680214 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 20:37:59.680214 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 20:37:59.680214 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 20:37:59.680214 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:37:59.680214 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:37:59.680214 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:37:59.680214 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:37:59.680214 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:37:59.680214 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:37:59.681068 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:37:59.681068 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:37:59.681068 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:37:59.681068 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:37:59.681068 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:37:59.681068 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:37:59.681068 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:37:59.681068 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:37:59.681068 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:37:59.681068 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:37:59.681068 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 20:37:59.681068 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:37:59.681068 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 15 20:37:59.681068 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:37:59.681068 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 328/664] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jul 15 20:37:59 2022] GET /identity/v3/services/network => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:37:59.681866 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512e4427-8948-454e-ad97-e763e42e105f None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:59.685375 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f813a3-6477-41eb-a4d0-4b743b2243fc None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:59.725193 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:59.726288 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bf0492-34df-447d-b6b0-afe472034d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:59.726959 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf0492-34df-447d-b6b0-afe472034d4b None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:59.728234 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf0492-34df-447d-b6b0-afe472034d4b None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:59.728344 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf0492-34df-447d-b6b0-afe472034d4b None admin] PATH_INFO: `/v3/projects` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:59.729168 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bf0492-34df-447d-b6b0-afe472034d4b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:59.729477 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bf0492-34df-447d-b6b0-afe472034d4b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:59.731002 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bf0492-34df-447d-b6b0-afe472034d4b None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:59.744242 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 337/665] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jul 15 20:37:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:37:59.750915 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bf0492-34df-447d-b6b0-afe472034d4b None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:59.819297 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f813a3-6477-41eb-a4d0-4b743b2243fc None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:59.867579 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36046946-c84a-435c-a6e5-5d5dd7b5680c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:59.868240 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36046946-c84a-435c-a6e5-5d5dd7b5680c None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:59.868523 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36046946-c84a-435c-a6e5-5d5dd7b5680c None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:59.868796 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36046946-c84a-435c-a6e5-5d5dd7b5680c None admin] PATH_INFO: `/v3/services` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:59.869706 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36046946-c84a-435c-a6e5-5d5dd7b5680c None admin] RBAC: Adding query filter params (name=network) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:59.869881 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36046946-c84a-435c-a6e5-5d5dd7b5680c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:59.871294 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36046946-c84a-435c-a6e5-5d5dd7b5680c None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:59.877032 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 329/666] 10.222.0.16 () {56 vars in 1112 bytes} [Fri Jul 15 20:37:59 2022] GET /identity/v3/services?name=network => generated 124 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:59.882299 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36046946-c84a-435c-a6e5-5d5dd7b5680c None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:59.884460 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bf0492-34df-447d-b6b0-afe472034d4b None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:59.888366 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:59.930975 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5a538b-8b14-4518-86d2-51ad899c5348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:59.931691 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a538b-8b14-4518-86d2-51ad899c5348 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:59.931979 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a538b-8b14-4518-86d2-51ad899c5348 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:59.932258 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a538b-8b14-4518-86d2-51ad899c5348 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:59.933091 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5a538b-8b14-4518-86d2-51ad899c5348 None admin] RBAC: Adding query filter params (role.id=cbcae224848142ce888ca5b84abfd18e, scope.project.id=0ea017caabac4346a1fc822ddfe3e8c2, user.id=b3e5296637584004b1888453ab9056c4) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:59.933405 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5a538b-8b14-4518-86d2-51ad899c5348 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:59.934921 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5a538b-8b14-4518-86d2-51ad899c5348 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:59.941610 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 338/667] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jul 15 20:37:59 2022] GET /identity/v3/role_assignments?user.id=b3e5296637584004b1888453ab9056c4&scope.project.id=0ea017caabac4346a1fc822ddfe3e8c2&role.id=cbcae224848142ce888ca5b84abfd18e => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:38:00.006386 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:00.015083 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36046946-c84a-435c-a6e5-5d5dd7b5680c None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:00.055829 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba0e078-d11a-4196-a7f7-94a9bb80c987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:00.056813 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba0e078-d11a-4196-a7f7-94a9bb80c987 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:00.057245 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba0e078-d11a-4196-a7f7-94a9bb80c987 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:00.057695 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba0e078-d11a-4196-a7f7-94a9bb80c987 None admin] PATH_INFO: `/v3/services` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:00.058690 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba0e078-d11a-4196-a7f7-94a9bb80c987 None admin] RBAC: Adding query filter params (type=network) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:38:00.059208 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba0e078-d11a-4196-a7f7-94a9bb80c987 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:00.060800 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba0e078-d11a-4196-a7f7-94a9bb80c987 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:00.067238 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 330/668] 10.222.0.16 () {56 vars in 1112 bytes} [Fri Jul 15 20:37:59 2022] GET /identity/v3/services?type=network => generated 124 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:38:01.362866 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d906c2b-f2ca-4eb7-93fa-0b1beb472ae5 None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:01.363395 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d906c2b-f2ca-4eb7-93fa-0b1beb472ae5 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:01.363699 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d906c2b-f2ca-4eb7-93fa-0b1beb472ae5 None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:01.365435 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 339/669] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:38:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:38:01.370736 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc529af-865b-4eb3-847f-43c5447ac181 None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:01.371159 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc529af-865b-4eb3-847f-43c5447ac181 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:01.371503 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc529af-865b-4eb3-847f-43c5447ac181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:01.388686 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-6bc529af-865b-4eb3-847f-43c5447ac181 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:01.390441 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-6bc529af-865b-4eb3-847f-43c5447ac181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:01.466242 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 331/670] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:38:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:38:01.485960 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d906c2b-f2ca-4eb7-93fa-0b1beb472ae5 None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:01.599176 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d906c2b-f2ca-4eb7-93fa-0b1beb472ae5 None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:01.636484 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a3f57-4696-4ade-ad48-717d6d801225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:01.637516 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a3f57-4696-4ade-ad48-717d6d801225 None admin] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:01.638031 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a3f57-4696-4ade-ad48-717d6d801225 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:01.638539 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a3f57-4696-4ade-ad48-717d6d801225 None admin] PATH_INFO: `/v3/services` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:01.639998 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922a3f57-4696-4ade-ad48-717d6d801225 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:01.641581 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922a3f57-4696-4ade-ad48-717d6d801225 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:01.662973 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 340/671] 10.222.0.16 () {60 vars in 1141 bytes} [Fri Jul 15 20:38:01 2022] POST /identity/v3/services => generated 242 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:38:01.885811 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea50d541-dd24-40dc-9cb7-93599914a28d None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:01.886578 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea50d541-dd24-40dc-9cb7-93599914a28d None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:01.887079 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea50d541-dd24-40dc-9cb7-93599914a28d None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:01.888958 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 332/672] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:38:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:38:01.894926 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a85b06-be7a-4f64-9413-9637d0f4e57e None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:01.895516 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a85b06-be7a-4f64-9413-9637d0f4e57e None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:01.896031 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a85b06-be7a-4f64-9413-9637d0f4e57e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:01.915376 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-28a85b06-be7a-4f64-9413-9637d0f4e57e None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:01.916907 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-28a85b06-be7a-4f64-9413-9637d0f4e57e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:01.942012 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:02.006440 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 341/673] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:38:01 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:38:02.026504 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea50d541-dd24-40dc-9cb7-93599914a28d None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:02.127522 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:02.144366 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea50d541-dd24-40dc-9cb7-93599914a28d None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:02.181565 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d365b3b4-1faa-4987-b08f-1b54b3bd2fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:02.182641 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d365b3b4-1faa-4987-b08f-1b54b3bd2fb0 None admin] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:02.183161 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d365b3b4-1faa-4987-b08f-1b54b3bd2fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:02.183641 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d365b3b4-1faa-4987-b08f-1b54b3bd2fb0 None admin] PATH_INFO: `/v3/services` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:02.184578 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d365b3b4-1faa-4987-b08f-1b54b3bd2fb0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:02.186323 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d365b3b4-1faa-4987-b08f-1b54b3bd2fb0 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:02.204070 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 333/674] 10.222.0.16 () {60 vars in 1141 bytes} [Fri Jul 15 20:38:02 2022] POST /identity/v3/services => generated 251 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:38:02.237458 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0703aca0-5f62-4369-bf40-240bff795c04 None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:02.238259 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0703aca0-5f62-4369-bf40-240bff795c04 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:02.238756 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0703aca0-5f62-4369-bf40-240bff795c04 None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:02.240576 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 342/675] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:38:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:38:02.246876 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df332f-a4ae-4f85-8241-11d51a337de6 None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:02.247543 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df332f-a4ae-4f85-8241-11d51a337de6 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:02.248060 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df332f-a4ae-4f85-8241-11d51a337de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:02.267902 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-d8df332f-a4ae-4f85-8241-11d51a337de6 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:02.269506 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-d8df332f-a4ae-4f85-8241-11d51a337de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:02.354650 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 334/676] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:38:02 2022] POST /identity/v3/auth/tokens => generated 999 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:38:02.377316 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0703aca0-5f62-4369-bf40-240bff795c04 None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:02.390949 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8048f3-8ba8-4aff-869d-f1adaf71361d None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:02.391478 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8048f3-8ba8-4aff-869d-f1adaf71361d None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:02.391620 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8048f3-8ba8-4aff-869d-f1adaf71361d None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:02.393755 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 335/677] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:38:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:38:02.399347 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61612c64-7e30-4f47-889b-01d18d258f37 None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:02.399564 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61612c64-7e30-4f47-889b-01d18d258f37 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:02.399851 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61612c64-7e30-4f47-889b-01d18d258f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:02.417494 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-61612c64-7e30-4f47-889b-01d18d258f37 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:02.420536 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-61612c64-7e30-4f47-889b-01d18d258f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:02.508671 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 336/678] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:38:02 2022] POST /identity/v3/auth/tokens => generated 999 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 20:38:02.525975 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0703aca0-5f62-4369-bf40-240bff795c04 None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:02.534193 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61612c64-7e30-4f47-889b-01d18d258f37 None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:02.537413 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:02.566906 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceb8d76-a804-4295-8a4d-4efad2134e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:02.567697 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb8d76-a804-4295-8a4d-4efad2134e22 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:02.567980 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb8d76-a804-4295-8a4d-4efad2134e22 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:02.568257 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb8d76-a804-4295-8a4d-4efad2134e22 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:02.579730 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceb8d76-a804-4295-8a4d-4efad2134e22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:38:02.588317 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-cceb8d76-a804-4295-8a4d-4efad2134e22 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:38:02.588317 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:38:02.588317 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:38:02.588317 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:38:02.588317 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:38:02.588317 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:38:02.588317 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:38:02.588317 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:38:02.588317 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:38:02.588317 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:38:02.588317 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:38:02.588317 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:38:02.588317 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:38:02.588317 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:38:02.588317 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:38:02.588317 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:38:02.591604 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:38:02.591604 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:38:02.591604 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:38:02.591604 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:38:02.591604 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:38:02.591604 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:38:02.591604 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:38:02.591604 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:38:02.591604 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:38:02.591604 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:38:02.591604 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:38:02.591604 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:38:02.591604 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:38:02.591604 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:38:02.591604 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:38:02.591604 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:38:02.592462 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:38:02.592462 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:38:02.592462 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:38:02.592462 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:38:02.592462 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:38:02.592462 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:38:02.592462 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:38:02.592462 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:38:02.592462 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:38:02.592462 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:38:02.592462 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:38:02.592462 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:38:02.592462 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 343/679] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Jul 15 20:38:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:38:02.595938 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceb8d76-a804-4295-8a4d-4efad2134e22 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:02.613437 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:02.650188 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61612c64-7e30-4f47-889b-01d18d258f37 None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:02.685464 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e7a219-dd80-443d-b455-3ab13a73d889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:02.687119 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e7a219-dd80-443d-b455-3ab13a73d889 None admin] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:02.687646 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e7a219-dd80-443d-b455-3ab13a73d889 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:02.688120 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e7a219-dd80-443d-b455-3ab13a73d889 None admin] PATH_INFO: `/v3/services` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:02.689405 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e7a219-dd80-443d-b455-3ab13a73d889 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:02.691158 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e7a219-dd80-443d-b455-3ab13a73d889 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:02.712230 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceb8d76-a804-4295-8a4d-4efad2134e22 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:02.714227 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 337/680] 10.222.0.16 () {60 vars in 1141 bytes} [Fri Jul 15 20:38:02 2022] POST /identity/v3/services => generated 240 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 20:38:02.764997 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea4079d-ce98-4bb1-910f-62fc522b99e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:02.766174 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea4079d-ce98-4bb1-910f-62fc522b99e5 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:02.766506 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea4079d-ce98-4bb1-910f-62fc522b99e5 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:02.766796 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea4079d-ce98-4bb1-910f-62fc522b99e5 None admin] PATH_INFO: `/v3/roles` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:02.767591 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea4079d-ce98-4bb1-910f-62fc522b99e5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:38:02.767909 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea4079d-ce98-4bb1-910f-62fc522b99e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:02.769455 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea4079d-ce98-4bb1-910f-62fc522b99e5 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:02.780086 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 344/681] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jul 15 20:38:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:38:02.787236 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e7a219-dd80-443d-b455-3ab13a73d889 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:02.858644 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:02.909413 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e7a219-dd80-443d-b455-3ab13a73d889 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:02.950401 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a66208-b81c-476f-a3a2-fbc284fa71d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:02.951197 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a66208-b81c-476f-a3a2-fbc284fa71d1 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:02.951512 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a66208-b81c-476f-a3a2-fbc284fa71d1 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:02.951784 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a66208-b81c-476f-a3a2-fbc284fa71d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:02.963434 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a66208-b81c-476f-a3a2-fbc284fa71d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:02.964887 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a66208-b81c-476f-a3a2-fbc284fa71d1 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:02.983863 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-35a66208-b81c-476f-a3a2-fbc284fa71d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:38:02.983863 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:38:02.983863 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:38:02.983863 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:38:02.983863 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:38:02.983863 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:38:02.983863 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:38:02.983863 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:38:02.983863 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:38:02.983863 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:38:02.983863 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:38:02.983863 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:38:02.983863 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:38:02.983863 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:38:02.983863 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:38:02.985888 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:38:02.985888 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:38:02.985888 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:38:02.985888 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:38:02.985888 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:38:02.985888 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:38:02.985888 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:38:02.985888 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:38:02.985888 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:38:02.985888 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:38:02.985888 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:38:02.985888 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:38:02.985888 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:38:02.985888 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:38:02.985888 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:38:02.985888 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:38:02.985888 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:38:02.987259 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:38:02.987259 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:38:02.987259 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:38:02.987259 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:38:02.987259 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 338/682] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jul 15 20:38:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:38:02.990769 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea4079d-ce98-4bb1-910f-62fc522b99e5 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:03.082099 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:03.113356 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea4079d-ce98-4bb1-910f-62fc522b99e5 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:03.155480 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd399ce-2fd3-4765-b3ad-b06d038e32f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:03.156149 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd399ce-2fd3-4765-b3ad-b06d038e32f4 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:03.156433 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd399ce-2fd3-4765-b3ad-b06d038e32f4 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:03.156717 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd399ce-2fd3-4765-b3ad-b06d038e32f4 None admin] PATH_INFO: `/v3/domains` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:03.157516 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd399ce-2fd3-4765-b3ad-b06d038e32f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:38:03.157826 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd399ce-2fd3-4765-b3ad-b06d038e32f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:03.159250 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd399ce-2fd3-4765-b3ad-b06d038e32f4 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:03.172311 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 345/683] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jul 15 20:38:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:38:03.177674 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a66208-b81c-476f-a3a2-fbc284fa71d1 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:03.281902 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a66208-b81c-476f-a3a2-fbc284fa71d1 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:03.299361 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:03.318553 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9517821f-80f5-4865-b18f-257b4574952a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:03.319270 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9517821f-80f5-4865-b18f-257b4574952a None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:03.319817 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9517821f-80f5-4865-b18f-257b4574952a None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:03.320094 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9517821f-80f5-4865-b18f-257b4574952a None admin] PATH_INFO: `/v3/users/nova` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:03.327962 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9517821f-80f5-4865-b18f-257b4574952a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:03.329386 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9517821f-80f5-4865-b18f-257b4574952a None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:03.343925 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-9517821f-80f5-4865-b18f-257b4574952a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 15 20:38:03.343925 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:38:03.343925 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:38:03.343925 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:38:03.343925 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:38:03.343925 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:38:03.343925 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:38:03.343925 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:38:03.343925 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:38:03.343925 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:38:03.343925 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:38:03.343925 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:38:03.343925 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 20:38:03.343925 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 20:38:03.343925 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 20:38:03.343925 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 20:38:03.346041 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:38:03.346041 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:38:03.346041 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 20:38:03.346041 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:38:03.346041 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 20:38:03.346041 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:38:03.346041 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:38:03.346041 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:38:03.346041 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:38:03.346041 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:38:03.346041 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:38:03.346041 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:38:03.346041 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:38:03.346041 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:38:03.346041 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:38:03.346041 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:38:03.346041 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:38:03.346041 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:38:03.348230 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:38:03.348230 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:38:03.348230 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 20:38:03.348230 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 20:38:03.348230 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 20:38:03.348230 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 20:38:03.348230 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 20:38:03.348230 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 20:38:03.348230 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 15 20:38:03.348230 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:38:03.348230 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 339/684] 10.222.0.16 () {56 vars in 1093 bytes} [Fri Jul 15 20:38:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:38:03.353241 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd399ce-2fd3-4765-b3ad-b06d038e32f4 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:03.456988 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd399ce-2fd3-4765-b3ad-b06d038e32f4 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:03.490843 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:03.495386 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31116304-fe1e-43e4-ba6b-d30a91171e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:03.496076 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31116304-fe1e-43e4-ba6b-d30a91171e64 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:03.496368 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31116304-fe1e-43e4-ba6b-d30a91171e64 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:03.496764 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31116304-fe1e-43e4-ba6b-d30a91171e64 None admin] PATH_INFO: `/v3/users` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:03.497794 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31116304-fe1e-43e4-ba6b-d30a91171e64 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:38:03.498195 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31116304-fe1e-43e4-ba6b-d30a91171e64 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:03.499885 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31116304-fe1e-43e4-ba6b-d30a91171e64 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:03.520650 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 346/685] 10.222.0.16 () {56 vars in 1133 bytes} [Fri Jul 15 20:38:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:38:03.525935 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9517821f-80f5-4865-b18f-257b4574952a None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:03.638129 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9517821f-80f5-4865-b18f-257b4574952a None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:03.675330 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22f3a8f-6572-4bba-bf6a-83f652bb8bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:03.676133 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22f3a8f-6572-4bba-bf6a-83f652bb8bec None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:03.676423 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22f3a8f-6572-4bba-bf6a-83f652bb8bec None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:03.678114 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22f3a8f-6572-4bba-bf6a-83f652bb8bec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:03.688208 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22f3a8f-6572-4bba-bf6a-83f652bb8bec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:03.689664 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22f3a8f-6572-4bba-bf6a-83f652bb8bec None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:03.708327 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-b22f3a8f-6572-4bba-bf6a-83f652bb8bec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:38:03.708327 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:38:03.708327 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:38:03.708327 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:38:03.708327 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:38:03.708327 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:38:03.708327 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:38:03.708327 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:38:03.708327 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:38:03.708327 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:38:03.708327 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:38:03.708327 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:38:03.708327 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:38:03.708327 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:38:03.708327 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:38:03.709230 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:38:03.709230 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:38:03.709230 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:38:03.709230 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:38:03.709230 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:38:03.709230 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:38:03.709230 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:38:03.709230 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:38:03.709230 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:38:03.709230 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:38:03.709230 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:38:03.709230 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:38:03.709230 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:38:03.709230 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:38:03.709230 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:38:03.709230 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:38:03.709230 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:38:03.710132 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:38:03.710132 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:38:03.710132 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:38:03.710132 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:38:03.710132 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 340/686] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jul 15 20:38:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:38:03.718290 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31116304-fe1e-43e4-ba6b-d30a91171e64 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:03.821949 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31116304-fe1e-43e4-ba6b-d30a91171e64 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:03.856520 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d41758d-5d8c-4c43-98cb-f373a1e8752a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:03.857179 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41758d-5d8c-4c43-98cb-f373a1e8752a None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:03.857516 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41758d-5d8c-4c43-98cb-f373a1e8752a None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:03.857831 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41758d-5d8c-4c43-98cb-f373a1e8752a None admin] PATH_INFO: `/v3/domains` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:03.858579 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d41758d-5d8c-4c43-98cb-f373a1e8752a None admin] RBAC: Adding query filter params (name=Default) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:38:03.858885 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d41758d-5d8c-4c43-98cb-f373a1e8752a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:03.860258 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d41758d-5d8c-4c43-98cb-f373a1e8752a None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:03.872267 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 347/687] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jul 15 20:38:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:38:03.878031 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22f3a8f-6572-4bba-bf6a-83f652bb8bec None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:03.912958 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:03.990341 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22f3a8f-6572-4bba-bf6a-83f652bb8bec None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:04.026224 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51d878d-dafe-4f71-bc2b-51d1fe47e139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:04.027038 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d878d-dafe-4f71-bc2b-51d1fe47e139 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:04.027334 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d878d-dafe-4f71-bc2b-51d1fe47e139 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:04.027621 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d878d-dafe-4f71-bc2b-51d1fe47e139 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:04.035928 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51d878d-dafe-4f71-bc2b-51d1fe47e139 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:04.037576 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51d878d-dafe-4f71-bc2b-51d1fe47e139 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:04.052271 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d323383-33f8-44d6-bb3a-3cf9e0033c52 None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:04.052575 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d323383-33f8-44d6-bb3a-3cf9e0033c52 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:04.052836 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d323383-33f8-44d6-bb3a-3cf9e0033c52 None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:04.052955 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-b51d878d-dafe-4f71-bc2b-51d1fe47e139 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:38:04.052955 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:38:04.052955 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:38:04.052955 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:38:04.052955 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:38:04.052955 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:38:04.052955 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:38:04.052955 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:38:04.052955 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:38:04.052955 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:38:04.052955 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:38:04.052955 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:38:04.052955 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 20:38:04.052955 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 20:38:04.052955 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 20:38:04.053768 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 20:38:04.053768 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:38:04.053768 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:38:04.053768 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:38:04.053768 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:38:04.053768 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:38:04.053768 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:38:04.053768 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:38:04.053768 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:38:04.053768 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:38:04.053768 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:38:04.053768 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:38:04.053768 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:38:04.053768 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:38:04.053768 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:38:04.053768 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:38:04.053768 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:38:04.054712 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 20:38:04.054712 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 20:38:04.054712 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 20:38:04.054712 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 20:38:04.054712 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 20:38:04.054712 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 20:38:04.054712 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:38:04.054712 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:38:04.054712 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 341/689] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jul 15 20:38:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:38:04.055441 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 348/689] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:38:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 20:38:04.062215 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014400e0-fcf4-4275-aab6-9a5f312321de None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:04.062215 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014400e0-fcf4-4275-aab6-9a5f312321de None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:04.062215 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014400e0-fcf4-4275-aab6-9a5f312321de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:04.062540 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d323383-33f8-44d6-bb3a-3cf9e0033c52 None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:04.081626 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-014400e0-fcf4-4275-aab6-9a5f312321de None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:04.082938 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-014400e0-fcf4-4275-aab6-9a5f312321de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:04.120916 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:04.163340 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 342/690] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:38:04 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 20:38:04.186700 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d323383-33f8-44d6-bb3a-3cf9e0033c52 None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:04.186991 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014400e0-fcf4-4275-aab6-9a5f312321de None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:04.220111 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:04.239045 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405d8698-b284-40a1-b60d-2b1b66c15367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:04.239851 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405d8698-b284-40a1-b60d-2b1b66c15367 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:04.240141 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405d8698-b284-40a1-b60d-2b1b66c15367 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:04.240504 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405d8698-b284-40a1-b60d-2b1b66c15367 None admin] PATH_INFO: `/v3/projects` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:04.241955 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405d8698-b284-40a1-b60d-2b1b66c15367 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:38:04.242301 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405d8698-b284-40a1-b60d-2b1b66c15367 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:04.244294 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405d8698-b284-40a1-b60d-2b1b66c15367 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:04.262462 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 349/691] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jul 15 20:38:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:38:04.268621 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405d8698-b284-40a1-b60d-2b1b66c15367 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:04.302315 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014400e0-fcf4-4275-aab6-9a5f312321de None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:04.341529 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d93920-123c-4d9a-bdca-743d186b6b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:04.342970 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d93920-123c-4d9a-bdca-743d186b6b68 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:04.343255 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d93920-123c-4d9a-bdca-743d186b6b68 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:04.343548 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d93920-123c-4d9a-bdca-743d186b6b68 None admin] PATH_INFO: `/v3/services/image` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:04.344182 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d93920-123c-4d9a-bdca-743d186b6b68 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:04.345534 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d93920-123c-4d9a-bdca-743d186b6b68 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:04.367309 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-e8d93920-123c-4d9a-bdca-743d186b6b68 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 15 20:38:04.367309 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:38:04.367309 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 20:38:04.367309 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 20:38:04.367309 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 20:38:04.367309 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 20:38:04.367309 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 20:38:04.367309 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:38:04.367309 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 15 20:38:04.367309 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:38:04.367309 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 20:38:04.367309 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:38:04.367309 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:38:04.367309 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:38:04.367309 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:38:04.367309 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:38:04.367309 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:38:04.368393 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:38:04.368393 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:38:04.368393 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:38:04.368393 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:38:04.368393 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:38:04.368393 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:38:04.368393 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 20:38:04.368393 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 20:38:04.368393 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 20:38:04.368393 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 20:38:04.368393 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:38:04.368393 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:38:04.368393 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:38:04.368393 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:38:04.368393 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:38:04.368393 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:38:04.369891 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:38:04.369891 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:38:04.369891 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:38:04.369891 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:38:04.369891 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:38:04.369891 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:38:04.369891 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:38:04.369891 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:38:04.369891 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:38:04.369891 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:38:04.369891 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 20:38:04.369891 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:38:04.369891 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 15 20:38:04.369891 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:38:04.372357 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 343/692] 10.222.0.16 () {56 vars in 1105 bytes} [Fri Jul 15 20:38:04 2022] GET /identity/v3/services/image => generated 86 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 20:38:04.380248 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d93920-123c-4d9a-bdca-743d186b6b68 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:04.401839 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405d8698-b284-40a1-b60d-2b1b66c15367 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:04.416530 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:04.455725 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9f2c81-bc07-4462-a339-123b83dd683e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:04.456622 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f2c81-bc07-4462-a339-123b83dd683e None admin] REQUEST_METHOD: `PUT` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:04.456906 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f2c81-bc07-4462-a339-123b83dd683e None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:04.457183 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f2c81-bc07-4462-a339-123b83dd683e None admin] PATH_INFO: `/v3/projects/0ea017caabac4346a1fc822ddfe3e8c2/users/b3e5296637584004b1888453ab9056c4/roles/cbcae224848142ce888ca5b84abfd18e` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:04.459904 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9f2c81-bc07-4462-a339-123b83dd683e None admin] RBAC: Authorizing `identity:create_grant(project_id=0ea017caabac4346a1fc822ddfe3e8c2, user_id=b3e5296637584004b1888453ab9056c4, role_id=cbcae224848142ce888ca5b84abfd18e)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:04.461715 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9f2c81-bc07-4462-a339-123b83dd683e None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:04.482111 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 350/693] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Jul 15 20:38:04 2022] PUT /identity/v3/projects/0ea017caabac4346a1fc822ddfe3e8c2/users/b3e5296637584004b1888453ab9056c4/roles/cbcae224848142ce888ca5b84abfd18e => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:38:04.499087 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:04.519158 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d93920-123c-4d9a-bdca-743d186b6b68 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:04.563433 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f812876b-b0f0-4060-a711-6e219b17e369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:04.564201 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f812876b-b0f0-4060-a711-6e219b17e369 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:04.564451 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f812876b-b0f0-4060-a711-6e219b17e369 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:04.564736 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f812876b-b0f0-4060-a711-6e219b17e369 None admin] PATH_INFO: `/v3/services` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:04.565516 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f812876b-b0f0-4060-a711-6e219b17e369 None admin] RBAC: Adding query filter params (name=image) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:38:04.565833 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f812876b-b0f0-4060-a711-6e219b17e369 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:04.567494 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f812876b-b0f0-4060-a711-6e219b17e369 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:04.573577 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 344/694] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jul 15 20:38:04 2022] GET /identity/v3/services?name=image => generated 122 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:38:04.579751 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9f2c81-bc07-4462-a339-123b83dd683e None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:04.685727 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207875e0-8ab6-4898-a5ac-0b01037e0b67 None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:04.686581 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207875e0-8ab6-4898-a5ac-0b01037e0b67 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:04.687172 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207875e0-8ab6-4898-a5ac-0b01037e0b67 None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:04.688740 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 345/695] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:38:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:38:04.693626 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9f2c81-bc07-4462-a339-123b83dd683e None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:04.695540 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c9f78-8d36-4aa7-bc9d-563201701bdf None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:04.696053 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c9f78-8d36-4aa7-bc9d-563201701bdf None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:04.697595 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c9f78-8d36-4aa7-bc9d-563201701bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:04.721812 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-8a9c9f78-8d36-4aa7-bc9d-563201701bdf None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:04.723041 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-8a9c9f78-8d36-4aa7-bc9d-563201701bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:04.731687 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28be35ae-b139-4a71-943e-b006436a23c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:04.732354 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28be35ae-b139-4a71-943e-b006436a23c8 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:04.732687 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28be35ae-b139-4a71-943e-b006436a23c8 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:04.732964 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28be35ae-b139-4a71-943e-b006436a23c8 None admin] PATH_INFO: `/v3/services` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:04.733674 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28be35ae-b139-4a71-943e-b006436a23c8 None admin] RBAC: Adding query filter params (type=image) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:38:04.733981 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28be35ae-b139-4a71-943e-b006436a23c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:04.735765 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28be35ae-b139-4a71-943e-b006436a23c8 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:04.743673 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 351/696] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jul 15 20:38:04 2022] GET /identity/v3/services?type=image => generated 350 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:38:04.751820 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28be35ae-b139-4a71-943e-b006436a23c8 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:04.794695 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:04.818306 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 346/697] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:38:04 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 20:38:04.836292 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9c9f78-8d36-4aa7-bc9d-563201701bdf None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:04.868629 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28be35ae-b139-4a71-943e-b006436a23c8 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:04.905485 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe94272-c228-4239-8b5e-aa84050894ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:04.906276 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe94272-c228-4239-8b5e-aa84050894ec None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:04.906607 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe94272-c228-4239-8b5e-aa84050894ec None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:04.906886 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe94272-c228-4239-8b5e-aa84050894ec None admin] PATH_INFO: `/v3/endpoints` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:04.907790 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe94272-c228-4239-8b5e-aa84050894ec None admin] RBAC: Adding query filter params (interface=public, service_id=c25d327f865941668349d21c4258d009, region_id=RegionOne) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:38:04.908105 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe94272-c228-4239-8b5e-aa84050894ec None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:04.909617 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe94272-c228-4239-8b5e-aa84050894ec None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:04.922408 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 352/698] 10.222.0.16 () {56 vars in 1251 bytes} [Fri Jul 15 20:38:04 2022] GET /identity/v3/endpoints?service_id=c25d327f865941668349d21c4258d009&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:38:04.923298 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe94272-c228-4239-8b5e-aa84050894ec None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:04.942450 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:04.946218 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9c9f78-8d36-4aa7-bc9d-563201701bdf None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:04.993347 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba2f549-e56b-425f-b262-15724a5f0e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:04.994611 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba2f549-e56b-425f-b262-15724a5f0e3e None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:04.994995 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba2f549-e56b-425f-b262-15724a5f0e3e None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:04.995371 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba2f549-e56b-425f-b262-15724a5f0e3e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:04.996392 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba2f549-e56b-425f-b262-15724a5f0e3e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:04.999226 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba2f549-e56b-425f-b262-15724a5f0e3e None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:05.016350 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-cba2f549-e56b-425f-b262-15724a5f0e3e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 15 20:38:05.016350 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:38:05.016350 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 20:38:05.016350 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 20:38:05.016350 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 20:38:05.016350 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 20:38:05.016350 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 20:38:05.016350 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:38:05.016350 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 15 20:38:05.016350 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:38:05.016350 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 20:38:05.016350 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:38:05.016350 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:38:05.016350 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:38:05.016350 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:38:05.016350 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:38:05.017371 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:38:05.017371 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:38:05.017371 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:38:05.017371 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:38:05.017371 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:38:05.017371 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:38:05.017371 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:38:05.017371 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 20:38:05.017371 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 20:38:05.017371 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 20:38:05.017371 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 20:38:05.017371 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:38:05.017371 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:38:05.017371 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:38:05.017371 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:38:05.017371 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:38:05.018250 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:38:05.018250 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:38:05.018250 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:38:05.018250 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:38:05.018250 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:38:05.018250 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:38:05.018250 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:38:05.018250 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:38:05.018250 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:38:05.018250 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:38:05.018250 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:38:05.018250 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 20:38:05.018250 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:38:05.018250 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 15 20:38:05.018250 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:38:05.022149 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 347/699] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jul 15 20:38:04 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 20:38:05.024521 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba2f549-e56b-425f-b262-15724a5f0e3e None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:05.055897 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:05.063714 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe94272-c228-4239-8b5e-aa84050894ec None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:05.102177 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a385bf-3552-4f04-91da-e295691c1c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:05.102841 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a385bf-3552-4f04-91da-e295691c1c5d None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:05.103126 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a385bf-3552-4f04-91da-e295691c1c5d None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:05.103450 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a385bf-3552-4f04-91da-e295691c1c5d None admin] PATH_INFO: `/v3/services` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:05.104133 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a385bf-3552-4f04-91da-e295691c1c5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:05.105996 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a385bf-3552-4f04-91da-e295691c1c5d None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:05.118422 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 353/700] 10.222.0.16 () {56 vars in 1087 bytes} [Fri Jul 15 20:38:04 2022] GET /identity/v3/services => generated 1002 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:38:05.155256 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba2f549-e56b-425f-b262-15724a5f0e3e None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:05.195134 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb393e3-7167-459f-a481-cbdfb7f16643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:05.196225 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb393e3-7167-459f-a481-cbdfb7f16643 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:05.196716 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb393e3-7167-459f-a481-cbdfb7f16643 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:05.197194 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb393e3-7167-459f-a481-cbdfb7f16643 None admin] PATH_INFO: `/v3/services` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:05.198204 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb393e3-7167-459f-a481-cbdfb7f16643 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:38:05.198789 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb393e3-7167-459f-a481-cbdfb7f16643 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:05.200420 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb393e3-7167-459f-a481-cbdfb7f16643 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:05.206458 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 348/701] 10.222.0.16 () {56 vars in 1124 bytes} [Fri Jul 15 20:38:05 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:38:05.211183 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50622cc8-dde3-4feb-8fbd-0ba383f13a18 None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:05.211183 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50622cc8-dde3-4feb-8fbd-0ba383f13a18 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:05.211183 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50622cc8-dde3-4feb-8fbd-0ba383f13a18 None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:05.211578 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 354/702] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:38:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:38:05.213008 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb393e3-7167-459f-a481-cbdfb7f16643 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:05.217053 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:05.222821 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2551f65-98b3-4401-a876-8f418c9afb74 None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:05.223234 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2551f65-98b3-4401-a876-8f418c9afb74 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:05.224050 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2551f65-98b3-4401-a876-8f418c9afb74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:05.242038 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-c2551f65-98b3-4401-a876-8f418c9afb74 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:05.243473 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-c2551f65-98b3-4401-a876-8f418c9afb74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:05.323358 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 355/703] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:38:05 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 20:38:05.336439 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb393e3-7167-459f-a481-cbdfb7f16643 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:05.353119 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2551f65-98b3-4401-a876-8f418c9afb74 None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:05.376335 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05637ac7-e7f8-4658-952f-5b7078ef2bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:05.377045 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05637ac7-e7f8-4658-952f-5b7078ef2bc4 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:05.377339 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05637ac7-e7f8-4658-952f-5b7078ef2bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:05.377621 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05637ac7-e7f8-4658-952f-5b7078ef2bc4 None admin] PATH_INFO: `/v3/services` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:05.378368 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05637ac7-e7f8-4658-952f-5b7078ef2bc4 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:38:05.378679 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05637ac7-e7f8-4658-952f-5b7078ef2bc4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:05.380100 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05637ac7-e7f8-4658-952f-5b7078ef2bc4 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:05.389776 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 349/704] 10.222.0.16 () {56 vars in 1124 bytes} [Fri Jul 15 20:38:05 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:38:05.391010 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05637ac7-e7f8-4658-952f-5b7078ef2bc4 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:05.457906 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:05.466624 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:05.474123 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2551f65-98b3-4401-a876-8f418c9afb74 None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:05.509207 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05637ac7-e7f8-4658-952f-5b7078ef2bc4 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:05.520121 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d8162d-1a6e-47eb-9595-70df18204d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:05.521403 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d8162d-1a6e-47eb-9595-70df18204d48 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:05.522043 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d8162d-1a6e-47eb-9595-70df18204d48 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:05.522420 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d8162d-1a6e-47eb-9595-70df18204d48 None admin] PATH_INFO: `/v3/services/network` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:05.523151 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d8162d-1a6e-47eb-9595-70df18204d48 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:05.525381 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d8162d-1a6e-47eb-9595-70df18204d48 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:05.542719 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-e8d8162d-1a6e-47eb-9595-70df18204d48 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 15 20:38:05.542719 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:38:05.542719 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 20:38:05.542719 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 20:38:05.542719 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 20:38:05.542719 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 20:38:05.542719 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 20:38:05.542719 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:38:05.542719 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 15 20:38:05.542719 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:38:05.542719 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 20:38:05.542719 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:38:05.542719 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:38:05.542719 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:38:05.542719 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:38:05.542719 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:38:05.542719 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:38:05.543916 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:38:05.543916 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:38:05.543916 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:38:05.543916 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:38:05.543916 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:38:05.543916 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:38:05.543916 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 20:38:05.543916 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 20:38:05.543916 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 20:38:05.543916 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 20:38:05.543916 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:38:05.543916 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:38:05.543916 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:38:05.543916 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:38:05.543916 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:38:05.543916 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:38:05.544947 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:38:05.544947 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:38:05.544947 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:38:05.544947 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:38:05.544947 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:38:05.544947 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:38:05.544947 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:38:05.544947 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:38:05.544947 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:38:05.544947 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:38:05.544947 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 20:38:05.544947 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:38:05.544947 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 15 20:38:05.544947 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:38:05.548064 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 356/705] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jul 15 20:38:05 2022] GET /identity/v3/services/network => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:38:05.550703 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d8162d-1a6e-47eb-9595-70df18204d48 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:05.552930 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9fec1c-eb4b-47d6-a57a-158faa84ebd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:05.553625 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9fec1c-eb4b-47d6-a57a-158faa84ebd9 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:05.553921 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9fec1c-eb4b-47d6-a57a-158faa84ebd9 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:05.554238 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9fec1c-eb4b-47d6-a57a-158faa84ebd9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:05.555022 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9fec1c-eb4b-47d6-a57a-158faa84ebd9 None admin] RBAC: Adding query filter params (interface=public, service_id=e6d6f975375349fdb3df38c48c23bb9f, region_id=RegionOne) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:38:05.556044 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9fec1c-eb4b-47d6-a57a-158faa84ebd9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:05.556744 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9fec1c-eb4b-47d6-a57a-158faa84ebd9 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:05.570364 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 350/706] 10.222.0.16 () {56 vars in 1251 bytes} [Fri Jul 15 20:38:05 2022] GET /identity/v3/endpoints?service_id=e6d6f975375349fdb3df38c48c23bb9f&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:38:05.571243 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9fec1c-eb4b-47d6-a57a-158faa84ebd9 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:05.679434 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d8162d-1a6e-47eb-9595-70df18204d48 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:05.685844 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9fec1c-eb4b-47d6-a57a-158faa84ebd9 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:05.730416 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:05.737276 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbf223f-759c-47a9-801c-f53b48a8987c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:05.738241 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf223f-759c-47a9-801c-f53b48a8987c None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:05.738466 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59feab6-d193-47ad-aa5d-18c206d5b771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:05.738966 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf223f-759c-47a9-801c-f53b48a8987c None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:05.739153 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59feab6-d193-47ad-aa5d-18c206d5b771 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:05.739417 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59feab6-d193-47ad-aa5d-18c206d5b771 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:05.739695 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59feab6-d193-47ad-aa5d-18c206d5b771 None admin] PATH_INFO: `/v3/services` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:05.740025 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf223f-759c-47a9-801c-f53b48a8987c None admin] PATH_INFO: `/v3/services` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:05.740403 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59feab6-d193-47ad-aa5d-18c206d5b771 None admin] RBAC: Adding query filter params (name=network) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:38:05.740713 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59feab6-d193-47ad-aa5d-18c206d5b771 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:05.741297 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbf223f-759c-47a9-801c-f53b48a8987c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:05.742092 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59feab6-d193-47ad-aa5d-18c206d5b771 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:05.743079 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbf223f-759c-47a9-801c-f53b48a8987c None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:05.748313 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 357/707] 10.222.0.16 () {56 vars in 1112 bytes} [Fri Jul 15 20:38:05 2022] GET /identity/v3/services?name=network => generated 124 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:38:05.750201 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 351/708] 10.222.0.16 () {56 vars in 1087 bytes} [Fri Jul 15 20:38:05 2022] GET /identity/v3/services => generated 1002 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:38:05.761169 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59feab6-d193-47ad-aa5d-18c206d5b771 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:05.802518 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:05.875692 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59feab6-d193-47ad-aa5d-18c206d5b771 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:05.914987 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a4fda0-447c-4b3e-94ed-f0fddb6c50dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:05.915674 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a4fda0-447c-4b3e-94ed-f0fddb6c50dc None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:05.915962 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a4fda0-447c-4b3e-94ed-f0fddb6c50dc None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:05.916244 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a4fda0-447c-4b3e-94ed-f0fddb6c50dc None admin] PATH_INFO: `/v3/services` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:05.916962 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a4fda0-447c-4b3e-94ed-f0fddb6c50dc None admin] RBAC: Adding query filter params (type=network) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:38:05.917273 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a4fda0-447c-4b3e-94ed-f0fddb6c50dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:05.918700 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a4fda0-447c-4b3e-94ed-f0fddb6c50dc None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:05.925353 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 358/709] 10.222.0.16 () {56 vars in 1112 bytes} [Fri Jul 15 20:38:05 2022] GET /identity/v3/services?type=network => generated 350 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:38:05.930702 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbf223f-759c-47a9-801c-f53b48a8987c None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:06.044185 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbf223f-759c-47a9-801c-f53b48a8987c None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:06.080911 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f83558-0134-4fa8-988c-beded222a429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:06.081577 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f83558-0134-4fa8-988c-beded222a429 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:06.081868 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f83558-0134-4fa8-988c-beded222a429 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:06.082180 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f83558-0134-4fa8-988c-beded222a429 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:06.082973 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f83558-0134-4fa8-988c-beded222a429 None admin] RBAC: Adding query filter params (interface=public, service_id=687822f5e7b547ac887c85e60f6f72e2, region_id=RegionOne) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:38:06.083296 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f83558-0134-4fa8-988c-beded222a429 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:06.084671 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f83558-0134-4fa8-988c-beded222a429 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:06.090259 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 352/710] 10.222.0.16 () {56 vars in 1251 bytes} [Fri Jul 15 20:38:05 2022] GET /identity/v3/endpoints?service_id=687822f5e7b547ac887c85e60f6f72e2&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:38:06.095729 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a4fda0-447c-4b3e-94ed-f0fddb6c50dc None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:06.190994 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:06.208169 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a4fda0-447c-4b3e-94ed-f0fddb6c50dc None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:06.243992 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c566aa-a5ec-4be4-9b5b-bb2badad42fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:06.244980 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c566aa-a5ec-4be4-9b5b-bb2badad42fc None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:06.245446 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c566aa-a5ec-4be4-9b5b-bb2badad42fc None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:06.245918 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c566aa-a5ec-4be4-9b5b-bb2badad42fc None admin] PATH_INFO: `/v3/services` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:06.246888 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c566aa-a5ec-4be4-9b5b-bb2badad42fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:06.249046 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c566aa-a5ec-4be4-9b5b-bb2badad42fc None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:06.260218 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 359/711] 10.222.0.16 () {56 vars in 1087 bytes} [Fri Jul 15 20:38:06 2022] GET /identity/v3/services => generated 1002 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:38:06.846260 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888368e7-9c01-4c99-ad0d-153e0a2134ab None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:06.847162 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888368e7-9c01-4c99-ad0d-153e0a2134ab None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:06.847642 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888368e7-9c01-4c99-ad0d-153e0a2134ab None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:06.849446 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 353/712] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:38:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:38:06.855059 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba44b2e-d750-4c83-aef1-452a04fdedaa None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:06.855844 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba44b2e-d750-4c83-aef1-452a04fdedaa None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:06.856319 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba44b2e-d750-4c83-aef1-452a04fdedaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:06.874218 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-7ba44b2e-d750-4c83-aef1-452a04fdedaa None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:06.875681 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-7ba44b2e-d750-4c83-aef1-452a04fdedaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:06.947519 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 360/713] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:38:06 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 20:38:06.974496 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888368e7-9c01-4c99-ad0d-153e0a2134ab None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:07.043025 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:07.089804 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888368e7-9c01-4c99-ad0d-153e0a2134ab None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:07.126313 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc389190-1e42-4264-b0cf-412883b75c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:07.127443 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc389190-1e42-4264-b0cf-412883b75c69 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:07.127934 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc389190-1e42-4264-b0cf-412883b75c69 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:07.128410 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc389190-1e42-4264-b0cf-412883b75c69 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:07.140084 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc389190-1e42-4264-b0cf-412883b75c69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:38:07.148580 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-dc389190-1e42-4264-b0cf-412883b75c69 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:38:07.148580 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:38:07.148580 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:38:07.148580 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:38:07.148580 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:38:07.148580 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:38:07.148580 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:38:07.148580 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:38:07.148580 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:38:07.148580 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:38:07.148580 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:38:07.148580 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:38:07.148580 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:38:07.148580 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:38:07.148580 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:38:07.148580 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:38:07.149511 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:38:07.149511 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:38:07.149511 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:38:07.149511 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:38:07.149511 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:38:07.149511 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:38:07.149511 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:38:07.149511 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:38:07.149511 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:38:07.149511 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:38:07.149511 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:38:07.149511 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:38:07.149511 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:38:07.149511 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:38:07.149511 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:38:07.149511 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:38:07.150364 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:38:07.150364 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:38:07.150364 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:38:07.150364 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:38:07.150364 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:38:07.150364 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:38:07.150364 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:38:07.150364 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:38:07.150364 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:38:07.150364 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:38:07.150364 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:38:07.150364 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:38:07.153009 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 354/714] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Jul 15 20:38:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:38:07.159045 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba44b2e-d750-4c83-aef1-452a04fdedaa None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:07.239247 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:07.264278 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba44b2e-d750-4c83-aef1-452a04fdedaa None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:07.303084 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd5d8b0-d0ce-4eba-8c9e-3659647afc43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:07.303764 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd5d8b0-d0ce-4eba-8c9e-3659647afc43 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:07.304052 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd5d8b0-d0ce-4eba-8c9e-3659647afc43 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:07.304335 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd5d8b0-d0ce-4eba-8c9e-3659647afc43 None admin] PATH_INFO: `/v3/roles` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:07.305084 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd5d8b0-d0ce-4eba-8c9e-3659647afc43 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:38:07.305394 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd5d8b0-d0ce-4eba-8c9e-3659647afc43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:07.306806 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd5d8b0-d0ce-4eba-8c9e-3659647afc43 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:07.316174 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 361/715] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jul 15 20:38:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:38:07.322063 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc389190-1e42-4264-b0cf-412883b75c69 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:07.435373 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc389190-1e42-4264-b0cf-412883b75c69 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:07.458635 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:07.478452 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524bbbf2-6038-416b-a945-e2fdd9e6bb8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:07.479543 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524bbbf2-6038-416b-a945-e2fdd9e6bb8d None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:07.480051 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524bbbf2-6038-416b-a945-e2fdd9e6bb8d None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:07.480532 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524bbbf2-6038-416b-a945-e2fdd9e6bb8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:07.492501 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524bbbf2-6038-416b-a945-e2fdd9e6bb8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:07.494246 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524bbbf2-6038-416b-a945-e2fdd9e6bb8d None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:07.512236 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-524bbbf2-6038-416b-a945-e2fdd9e6bb8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:38:07.512236 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:38:07.512236 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:38:07.512236 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:38:07.512236 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:38:07.512236 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:38:07.512236 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:38:07.512236 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:38:07.512236 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:38:07.512236 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:38:07.512236 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:38:07.512236 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:38:07.512236 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:38:07.512236 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:38:07.512236 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:38:07.513134 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:38:07.513134 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:38:07.513134 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:38:07.513134 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:38:07.513134 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:38:07.513134 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:38:07.513134 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:38:07.513134 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:38:07.513134 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:38:07.513134 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:38:07.513134 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:38:07.513134 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:38:07.513134 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:38:07.513134 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:38:07.513134 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:38:07.513134 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:38:07.513134 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:38:07.514182 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:38:07.514182 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:38:07.514182 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:38:07.514182 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:38:07.516451 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 355/716] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jul 15 20:38:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:38:07.522236 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd5d8b0-d0ce-4eba-8c9e-3659647afc43 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:07.526408 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baeeee5-bc91-470c-9c97-c13c9b4d980b None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:07.526971 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baeeee5-bc91-470c-9c97-c13c9b4d980b None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:07.527252 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baeeee5-bc91-470c-9c97-c13c9b4d980b None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:07.528711 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 356/717] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:38:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 20:38:07.533980 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a812a-8376-4532-8f32-bfc77e4b0639 None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:07.534608 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a812a-8376-4532-8f32-bfc77e4b0639 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:07.535185 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a812a-8376-4532-8f32-bfc77e4b0639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:07.555342 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-4a6a812a-8376-4532-8f32-bfc77e4b0639 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:07.556519 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-4a6a812a-8376-4532-8f32-bfc77e4b0639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:07.627255 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 357/718] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:38:07 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 20:38:07.651229 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6a812a-8376-4532-8f32-bfc77e4b0639 None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:07.655293 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd5d8b0-d0ce-4eba-8c9e-3659647afc43 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:07.690891 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76326987-6655-4ad5-810f-123714a5835a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:07.691989 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76326987-6655-4ad5-810f-123714a5835a None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:07.692489 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76326987-6655-4ad5-810f-123714a5835a None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:07.692974 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76326987-6655-4ad5-810f-123714a5835a None admin] PATH_INFO: `/v3/domains` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:07.693909 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76326987-6655-4ad5-810f-123714a5835a None admin] RBAC: Adding query filter params (name=Default) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:38:07.694439 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76326987-6655-4ad5-810f-123714a5835a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:07.696252 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76326987-6655-4ad5-810f-123714a5835a None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:07.706590 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:07.714114 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 362/719] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jul 15 20:38:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:38:07.717932 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76326987-6655-4ad5-810f-123714a5835a None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:07.777457 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6a812a-8376-4532-8f32-bfc77e4b0639 None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:07.779695 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:07.822554 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe74e19-fbcd-40ae-b61d-d648d55a60b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:07.823344 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe74e19-fbcd-40ae-b61d-d648d55a60b0 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:07.823632 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe74e19-fbcd-40ae-b61d-d648d55a60b0 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:07.823912 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe74e19-fbcd-40ae-b61d-d648d55a60b0 None admin] PATH_INFO: `/v3/services/image` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:07.824718 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe74e19-fbcd-40ae-b61d-d648d55a60b0 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:07.827057 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe74e19-fbcd-40ae-b61d-d648d55a60b0 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:07.842361 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-bbe74e19-fbcd-40ae-b61d-d648d55a60b0 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 15 20:38:07.842361 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:38:07.842361 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 20:38:07.842361 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 20:38:07.842361 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 20:38:07.842361 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 20:38:07.842361 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 20:38:07.842361 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:38:07.842361 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 15 20:38:07.842361 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:38:07.842361 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 20:38:07.842361 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:38:07.842361 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:38:07.842361 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:38:07.842361 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:38:07.842361 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:38:07.842361 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:38:07.843352 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:38:07.843352 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:38:07.843352 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:38:07.843352 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:38:07.843352 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:38:07.843352 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:38:07.843352 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 20:38:07.843352 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 20:38:07.843352 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 20:38:07.843352 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 20:38:07.843352 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:38:07.843352 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:38:07.843352 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:38:07.843352 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:38:07.843352 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:38:07.843352 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:38:07.844221 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:38:07.844221 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:38:07.844221 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:38:07.844221 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:38:07.844221 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:38:07.844221 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:38:07.844221 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:38:07.844221 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:38:07.844221 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:38:07.844221 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:38:07.844221 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 20:38:07.844221 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:38:07.844221 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 15 20:38:07.844221 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:38:07.846221 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 358/720] 10.222.0.16 () {56 vars in 1105 bytes} [Fri Jul 15 20:38:07 2022] GET /identity/v3/services/image => generated 86 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:38:07.849341 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe74e19-fbcd-40ae-b61d-d648d55a60b0 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:07.851538 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76326987-6655-4ad5-810f-123714a5835a None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:07.892311 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab5c658-0df1-43ac-8631-0b15387252cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:07.893101 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab5c658-0df1-43ac-8631-0b15387252cc None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:07.893391 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab5c658-0df1-43ac-8631-0b15387252cc None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:07.893713 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab5c658-0df1-43ac-8631-0b15387252cc None admin] PATH_INFO: `/v3/users/nova` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:07.901972 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab5c658-0df1-43ac-8631-0b15387252cc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:07.903536 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab5c658-0df1-43ac-8631-0b15387252cc None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:07.920624 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-7ab5c658-0df1-43ac-8631-0b15387252cc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 15 20:38:07.920624 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:38:07.920624 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:38:07.920624 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:38:07.920624 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:38:07.920624 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:38:07.920624 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:38:07.920624 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:38:07.920624 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:38:07.920624 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:38:07.920624 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:38:07.920624 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:38:07.920624 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 20:38:07.920624 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 20:38:07.920624 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 20:38:07.920624 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 20:38:07.921605 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:38:07.921605 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:38:07.921605 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 20:38:07.921605 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:38:07.921605 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 20:38:07.921605 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:38:07.921605 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:38:07.921605 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:38:07.921605 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:38:07.921605 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:38:07.921605 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:38:07.921605 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:38:07.921605 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:38:07.921605 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:38:07.921605 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:38:07.921605 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:38:07.921605 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:38:07.921605 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:38:07.922607 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:38:07.922607 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:38:07.922607 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 20:38:07.922607 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 20:38:07.922607 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 20:38:07.922607 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 20:38:07.922607 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 20:38:07.922607 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 20:38:07.922607 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 15 20:38:07.922607 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:38:07.926589 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 363/721] 10.222.0.16 () {56 vars in 1093 bytes} [Fri Jul 15 20:38:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 20:38:07.927531 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab5c658-0df1-43ac-8631-0b15387252cc None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:07.988909 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe74e19-fbcd-40ae-b61d-d648d55a60b0 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:07.994293 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:08.042973 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474b3394-3695-4df6-b377-7378040a8e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:08.043890 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b3394-3695-4df6-b377-7378040a8e51 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:08.044321 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b3394-3695-4df6-b377-7378040a8e51 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:08.044770 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b3394-3695-4df6-b377-7378040a8e51 None admin] PATH_INFO: `/v3/services` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:08.045787 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab5c658-0df1-43ac-8631-0b15387252cc None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:08.046418 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474b3394-3695-4df6-b377-7378040a8e51 None admin] RBAC: Adding query filter params (name=image) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:38:08.046875 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474b3394-3695-4df6-b377-7378040a8e51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:08.049569 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474b3394-3695-4df6-b377-7378040a8e51 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:08.059730 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 359/722] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jul 15 20:38:07 2022] GET /identity/v3/services?name=image => generated 122 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:38:08.061718 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474b3394-3695-4df6-b377-7378040a8e51 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:08.090093 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc70348-efb2-4a6b-a2d6-b6d8b4757a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:08.090872 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc70348-efb2-4a6b-a2d6-b6d8b4757a72 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:08.091167 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc70348-efb2-4a6b-a2d6-b6d8b4757a72 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:08.091446 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc70348-efb2-4a6b-a2d6-b6d8b4757a72 None admin] PATH_INFO: `/v3/users` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:08.092950 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc70348-efb2-4a6b-a2d6-b6d8b4757a72 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:38:08.093320 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc70348-efb2-4a6b-a2d6-b6d8b4757a72 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:08.094886 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc70348-efb2-4a6b-a2d6-b6d8b4757a72 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:08.103471 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:08.117682 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 364/723] 10.222.0.16 () {56 vars in 1133 bytes} [Fri Jul 15 20:38:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:38:08.123385 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc70348-efb2-4a6b-a2d6-b6d8b4757a72 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:08.189429 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474b3394-3695-4df6-b377-7378040a8e51 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:08.227731 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b356243-7a7c-490c-8d7e-e852f270a825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:08.228396 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b356243-7a7c-490c-8d7e-e852f270a825 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:08.228685 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b356243-7a7c-490c-8d7e-e852f270a825 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:08.228962 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b356243-7a7c-490c-8d7e-e852f270a825 None admin] PATH_INFO: `/v3/services` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:08.229666 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b356243-7a7c-490c-8d7e-e852f270a825 None admin] RBAC: Adding query filter params (type=image) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:38:08.229978 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b356243-7a7c-490c-8d7e-e852f270a825 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:08.231377 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b356243-7a7c-490c-8d7e-e852f270a825 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:08.240726 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 360/724] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jul 15 20:38:08 2022] GET /identity/v3/services?type=image => generated 350 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:38:08.240884 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc70348-efb2-4a6b-a2d6-b6d8b4757a72 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:08.240970 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9011da1e-dedc-484b-b37a-f4fddb578b3b None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:08.240970 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9011da1e-dedc-484b-b37a-f4fddb578b3b None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:08.240970 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9011da1e-dedc-484b-b37a-f4fddb578b3b None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:08.240970 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 361/725] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:38:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:38:08.241989 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9011da1e-dedc-484b-b37a-f4fddb578b3b None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:08.261855 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:08.281217 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf79151-812c-48e4-b9f9-f3052ad6380d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:08.281979 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf79151-812c-48e4-b9f9-f3052ad6380d None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:08.282423 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf79151-812c-48e4-b9f9-f3052ad6380d None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:08.282706 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf79151-812c-48e4-b9f9-f3052ad6380d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:08.350818 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:08.354747 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf79151-812c-48e4-b9f9-f3052ad6380d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:08.356249 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf79151-812c-48e4-b9f9-f3052ad6380d None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:08.360012 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9011da1e-dedc-484b-b37a-f4fddb578b3b None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:08.395314 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7164b5-889e-477c-b82f-9174cd0ca2de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:08.395975 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7164b5-889e-477c-b82f-9174cd0ca2de None admin] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:08.396393 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7164b5-889e-477c-b82f-9174cd0ca2de None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:08.396557 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7164b5-889e-477c-b82f-9174cd0ca2de None admin] PATH_INFO: `/v3/endpoints` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:08.397282 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7164b5-889e-477c-b82f-9174cd0ca2de None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:08.398690 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7164b5-889e-477c-b82f-9174cd0ca2de None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:08.422109 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 362/726] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Jul 15 20:38:08 2022] POST /identity/v3/endpoints => generated 327 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:38:08.423811 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f648d7-7c4d-4be0-a0de-d478cd30088e None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:08.424157 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f648d7-7c4d-4be0-a0de-d478cd30088e None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:08.424443 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f648d7-7c4d-4be0-a0de-d478cd30088e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:08.442805 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-e5f648d7-7c4d-4be0-a0de-d478cd30088e None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:08.444185 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-e5f648d7-7c4d-4be0-a0de-d478cd30088e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:08.503961 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 365/727] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jul 15 20:38:08 2022] GET /identity/v3/auth/tokens => generated 1098 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 15 20:38:08.505205 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf79151-812c-48e4-b9f9-f3052ad6380d None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:08.525671 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:08.555100 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 363/728] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:38:08 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 20:38:08.583664 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f648d7-7c4d-4be0-a0de-d478cd30088e None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:08.625036 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf79151-812c-48e4-b9f9-f3052ad6380d None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:08.663141 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed09e4ec-30e0-4f88-936d-0beb11338594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:08.664298 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed09e4ec-30e0-4f88-936d-0beb11338594 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:08.664591 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed09e4ec-30e0-4f88-936d-0beb11338594 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:08.664987 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed09e4ec-30e0-4f88-936d-0beb11338594 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:08.678056 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed09e4ec-30e0-4f88-936d-0beb11338594 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:08.679863 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed09e4ec-30e0-4f88-936d-0beb11338594 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:08.680438 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:08.703463 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-ed09e4ec-30e0-4f88-936d-0beb11338594 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:38:08.703463 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:38:08.703463 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:38:08.703463 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:38:08.703463 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:38:08.703463 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:38:08.703463 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:38:08.703463 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:38:08.703463 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:38:08.703463 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:38:08.703463 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:38:08.703463 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:38:08.703463 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:38:08.703463 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:38:08.703463 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:38:08.704392 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:38:08.704392 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:38:08.704392 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:38:08.704392 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:38:08.704392 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:38:08.704392 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:38:08.704392 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:38:08.704392 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:38:08.704392 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:38:08.704392 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:38:08.704392 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:38:08.704392 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:38:08.704392 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:38:08.704392 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:38:08.704392 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:38:08.704392 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:38:08.704392 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:38:08.705348 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:38:08.705348 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:38:08.705348 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:38:08.705348 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:38:08.705769 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f648d7-7c4d-4be0-a0de-d478cd30088e None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:08.707264 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 366/729] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jul 15 20:38:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:38:08.708786 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e0e79-ec36-45bb-90a1-264bd58b8753 None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:08.709078 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e0e79-ec36-45bb-90a1-264bd58b8753 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:08.709362 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e0e79-ec36-45bb-90a1-264bd58b8753 None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:08.710759 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 367/730] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:38:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:38:08.713917 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0e0e79-ec36-45bb-90a1-264bd58b8753 None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:08.744048 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa39636-d4a2-464f-90c8-a20bfba44c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:08.745117 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa39636-d4a2-464f-90c8-a20bfba44c3d None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:08.745558 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa39636-d4a2-464f-90c8-a20bfba44c3d None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:08.745978 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa39636-d4a2-464f-90c8-a20bfba44c3d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:08.746913 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa39636-d4a2-464f-90c8-a20bfba44c3d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:08.749053 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa39636-d4a2-464f-90c8-a20bfba44c3d None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:08.762947 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-7aa39636-d4a2-464f-90c8-a20bfba44c3d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 15 20:38:08.762947 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:38:08.762947 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 20:38:08.762947 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 20:38:08.762947 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 20:38:08.762947 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 20:38:08.762947 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 20:38:08.762947 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:38:08.762947 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 15 20:38:08.762947 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:38:08.762947 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 20:38:08.762947 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:38:08.762947 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:38:08.762947 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:38:08.762947 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:38:08.762947 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:38:08.764560 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:38:08.764560 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:38:08.764560 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:38:08.764560 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:38:08.764560 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:38:08.764560 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:38:08.764560 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:38:08.764560 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 20:38:08.764560 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 20:38:08.764560 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 20:38:08.764560 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 20:38:08.764560 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:38:08.764560 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:38:08.764560 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:38:08.764560 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:38:08.764560 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:38:08.770388 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:38:08.770388 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:38:08.770388 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:38:08.770388 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:38:08.770388 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:38:08.770388 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:38:08.770388 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:38:08.770388 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:38:08.770388 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:38:08.770388 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:38:08.770388 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:38:08.770388 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 20:38:08.770388 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:38:08.770388 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 15 20:38:08.770388 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:38:08.770388 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 364/731] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jul 15 20:38:08 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 20:38:08.771340 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2bbbd-2a55-4b3d-a091-35556d22c238 None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:08.771340 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2bbbd-2a55-4b3d-a091-35556d22c238 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:08.771340 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2bbbd-2a55-4b3d-a091-35556d22c238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:08.785987 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-a3e2bbbd-2a55-4b3d-a091-35556d22c238 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:08.787307 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-a3e2bbbd-2a55-4b3d-a091-35556d22c238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:08.793945 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:08.831845 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0e0e79-ec36-45bb-90a1-264bd58b8753 None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:08.857799 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 365/732] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:38:08 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 20:38:08.859249 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e2bbbd-2a55-4b3d-a091-35556d22c238 None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:08.883454 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce5dbaa-0f0f-478b-8e59-bc2876b4b7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:08.884468 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5dbaa-0f0f-478b-8e59-bc2876b4b7ca None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:08.884960 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5dbaa-0f0f-478b-8e59-bc2876b4b7ca None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:08.885417 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5dbaa-0f0f-478b-8e59-bc2876b4b7ca None admin] PATH_INFO: `/v3/domains` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:08.886445 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce5dbaa-0f0f-478b-8e59-bc2876b4b7ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:38:08.887103 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce5dbaa-0f0f-478b-8e59-bc2876b4b7ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:08.888666 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce5dbaa-0f0f-478b-8e59-bc2876b4b7ca None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:08.900210 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 368/733] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jul 15 20:38:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:38:08.905215 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce5dbaa-0f0f-478b-8e59-bc2876b4b7ca None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:08.943517 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:08.977846 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e2bbbd-2a55-4b3d-a091-35556d22c238 None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:09.008711 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce5dbaa-0f0f-478b-8e59-bc2876b4b7ca None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:09.015613 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f2fd51-3dd5-401d-8a58-8c64bcc8bb49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:09.016213 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f2fd51-3dd5-401d-8a58-8c64bcc8bb49 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:09.016497 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f2fd51-3dd5-401d-8a58-8c64bcc8bb49 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:09.016775 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f2fd51-3dd5-401d-8a58-8c64bcc8bb49 None admin] PATH_INFO: `/v3/services` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:09.017475 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f2fd51-3dd5-401d-8a58-8c64bcc8bb49 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:38:09.017781 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f2fd51-3dd5-401d-8a58-8c64bcc8bb49 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:09.019183 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f2fd51-3dd5-401d-8a58-8c64bcc8bb49 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:09.028494 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 366/734] 10.222.0.16 () {56 vars in 1124 bytes} [Fri Jul 15 20:38:08 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:38:09.028494 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f2fd51-3dd5-401d-8a58-8c64bcc8bb49 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:09.045851 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:09.052558 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f521428c-8abd-419d-ad04-a5df00ee0acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:09.053361 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f521428c-8abd-419d-ad04-a5df00ee0acd None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:09.053648 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f521428c-8abd-419d-ad04-a5df00ee0acd None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:09.053929 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f521428c-8abd-419d-ad04-a5df00ee0acd None admin] PATH_INFO: `/v3/services/network` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:09.054610 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f521428c-8abd-419d-ad04-a5df00ee0acd None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:09.055995 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f521428c-8abd-419d-ad04-a5df00ee0acd None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:09.068426 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-f521428c-8abd-419d-ad04-a5df00ee0acd None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 15 20:38:09.068426 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:38:09.068426 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 20:38:09.068426 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 20:38:09.068426 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 20:38:09.068426 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 20:38:09.068426 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 20:38:09.068426 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:38:09.068426 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 15 20:38:09.068426 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:38:09.068426 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 20:38:09.068426 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:38:09.068426 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:38:09.068426 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:38:09.068426 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:38:09.068426 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:38:09.068426 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:38:09.069380 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:38:09.069380 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:38:09.069380 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:38:09.069380 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:38:09.069380 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:38:09.069380 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:38:09.069380 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 20:38:09.069380 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 20:38:09.069380 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 20:38:09.069380 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 20:38:09.069380 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:38:09.069380 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:38:09.069380 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:38:09.069380 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:38:09.069380 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:38:09.069380 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:38:09.070488 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:38:09.070488 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:38:09.070488 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:38:09.070488 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:38:09.070488 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:38:09.070488 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:38:09.070488 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:38:09.070488 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:38:09.070488 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:38:09.070488 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:38:09.070488 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 20:38:09.070488 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:38:09.070488 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 15 20:38:09.070488 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:38:09.070488 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 369/735] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jul 15 20:38:08 2022] GET /identity/v3/services/network => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:38:09.071257 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f521428c-8abd-419d-ad04-a5df00ee0acd None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:09.140892 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f2fd51-3dd5-401d-8a58-8c64bcc8bb49 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:09.175630 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e708eac0-488d-4df1-9fe1-ce2db6699a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:09.176414 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e708eac0-488d-4df1-9fe1-ce2db6699a31 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:09.176707 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e708eac0-488d-4df1-9fe1-ce2db6699a31 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:09.176988 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e708eac0-488d-4df1-9fe1-ce2db6699a31 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:09.178910 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:09.181698 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f521428c-8abd-419d-ad04-a5df00ee0acd None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:09.184089 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e708eac0-488d-4df1-9fe1-ce2db6699a31 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:09.186010 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e708eac0-488d-4df1-9fe1-ce2db6699a31 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:09.200430 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-e708eac0-488d-4df1-9fe1-ce2db6699a31 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:38:09.200430 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:38:09.200430 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:38:09.200430 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:38:09.200430 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:38:09.200430 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:38:09.200430 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:38:09.200430 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:38:09.200430 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:38:09.200430 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:38:09.200430 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:38:09.200430 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:38:09.200430 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 20:38:09.200430 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 20:38:09.200430 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 20:38:09.202202 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 20:38:09.202202 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:38:09.202202 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:38:09.202202 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:38:09.202202 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:38:09.202202 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:38:09.202202 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:38:09.202202 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:38:09.202202 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:38:09.202202 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:38:09.202202 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:38:09.202202 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:38:09.202202 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:38:09.202202 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:38:09.202202 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:38:09.202202 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:38:09.202202 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:38:09.203090 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 20:38:09.203090 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 20:38:09.203090 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 20:38:09.203090 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 20:38:09.203090 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 20:38:09.203090 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 20:38:09.203090 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:38:09.203090 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:38:09.203090 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 367/736] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jul 15 20:38:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:38:09.203635 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e708eac0-488d-4df1-9fe1-ce2db6699a31 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:09.227000 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb96925-315d-4d33-816d-63465e60a64e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:09.227906 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb96925-315d-4d33-816d-63465e60a64e None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:09.228454 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb96925-315d-4d33-816d-63465e60a64e None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:09.228739 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb96925-315d-4d33-816d-63465e60a64e None admin] PATH_INFO: `/v3/services` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:09.229539 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb96925-315d-4d33-816d-63465e60a64e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:38:09.229856 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb96925-315d-4d33-816d-63465e60a64e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:09.231394 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb96925-315d-4d33-816d-63465e60a64e None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:09.237112 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 370/737] 10.222.0.16 () {56 vars in 1124 bytes} [Fri Jul 15 20:38:09 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:38:09.237908 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb96925-315d-4d33-816d-63465e60a64e None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:09.299590 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:09.309961 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e708eac0-488d-4df1-9fe1-ce2db6699a31 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:09.343644 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb96925-315d-4d33-816d-63465e60a64e None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:09.346305 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7416c33-2b38-4a36-a99e-39708bd05a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:09.346962 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7416c33-2b38-4a36-a99e-39708bd05a6e None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:09.347251 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7416c33-2b38-4a36-a99e-39708bd05a6e None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:09.347529 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7416c33-2b38-4a36-a99e-39708bd05a6e None admin] PATH_INFO: `/v3/services` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:09.348227 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7416c33-2b38-4a36-a99e-39708bd05a6e None admin] RBAC: Adding query filter params (name=network) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:38:09.348535 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7416c33-2b38-4a36-a99e-39708bd05a6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:09.349894 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7416c33-2b38-4a36-a99e-39708bd05a6e None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:09.359505 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 368/738] 10.222.0.16 () {56 vars in 1112 bytes} [Fri Jul 15 20:38:09 2022] GET /identity/v3/services?name=network => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:38:09.359505 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7416c33-2b38-4a36-a99e-39708bd05a6e None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:09.391688 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871d6191-78b0-40cc-8484-9af418c33041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:09.392512 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d6191-78b0-40cc-8484-9af418c33041 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:09.393198 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d6191-78b0-40cc-8484-9af418c33041 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:09.393503 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d6191-78b0-40cc-8484-9af418c33041 None admin] PATH_INFO: `/v3/projects` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:09.394594 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871d6191-78b0-40cc-8484-9af418c33041 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:38:09.394913 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871d6191-78b0-40cc-8484-9af418c33041 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:09.397253 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871d6191-78b0-40cc-8484-9af418c33041 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:09.415951 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 371/739] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jul 15 20:38:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:38:09.415951 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871d6191-78b0-40cc-8484-9af418c33041 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:09.420227 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:09.465846 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7416c33-2b38-4a36-a99e-39708bd05a6e None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:09.505698 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65345a9d-7331-45d3-a2e0-fe505b60ca52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:09.506536 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65345a9d-7331-45d3-a2e0-fe505b60ca52 None admin] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:09.506830 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65345a9d-7331-45d3-a2e0-fe505b60ca52 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:09.507107 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65345a9d-7331-45d3-a2e0-fe505b60ca52 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:09.508269 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65345a9d-7331-45d3-a2e0-fe505b60ca52 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:09.509569 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65345a9d-7331-45d3-a2e0-fe505b60ca52 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:09.528059 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871d6191-78b0-40cc-8484-9af418c33041 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:09.528846 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 369/740] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Jul 15 20:38:09 2022] POST /identity/v3/endpoints => generated 346 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:38:09.535132 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65345a9d-7331-45d3-a2e0-fe505b60ca52 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:09.557932 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:09.599150 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b4e21c-0e97-4668-a721-e3d9f6e4fb8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:09.600399 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b4e21c-0e97-4668-a721-e3d9f6e4fb8e None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:09.600960 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b4e21c-0e97-4668-a721-e3d9f6e4fb8e None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:09.601655 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b4e21c-0e97-4668-a721-e3d9f6e4fb8e None admin] PATH_INFO: `/v3/services` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:09.603109 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b4e21c-0e97-4668-a721-e3d9f6e4fb8e None admin] RBAC: Adding query filter params (type=network) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:38:09.603636 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b4e21c-0e97-4668-a721-e3d9f6e4fb8e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:09.605274 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b4e21c-0e97-4668-a721-e3d9f6e4fb8e None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:09.619391 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 372/741] 10.222.0.16 () {56 vars in 1112 bytes} [Fri Jul 15 20:38:09 2022] GET /identity/v3/services?type=network => generated 350 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:38:09.621003 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b4e21c-0e97-4668-a721-e3d9f6e4fb8e None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:09.670737 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65345a9d-7331-45d3-a2e0-fe505b60ca52 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:09.687126 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:09.711305 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da2f383-5b66-4fce-8665-01b20c7e505c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:09.712510 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da2f383-5b66-4fce-8665-01b20c7e505c None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:09.712837 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da2f383-5b66-4fce-8665-01b20c7e505c None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:09.713127 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da2f383-5b66-4fce-8665-01b20c7e505c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:09.713972 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da2f383-5b66-4fce-8665-01b20c7e505c None admin] RBAC: Adding query filter params (role.id=cbcae224848142ce888ca5b84abfd18e, scope.project.id=0ea017caabac4346a1fc822ddfe3e8c2, user.id=b3e5296637584004b1888453ab9056c4) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:38:09.714326 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da2f383-5b66-4fce-8665-01b20c7e505c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:09.715768 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da2f383-5b66-4fce-8665-01b20c7e505c None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:09.723401 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 370/742] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jul 15 20:38:09 2022] GET /identity/v3/role_assignments?user.id=b3e5296637584004b1888453ab9056c4&scope.project.id=0ea017caabac4346a1fc822ddfe3e8c2&role.id=cbcae224848142ce888ca5b84abfd18e => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:38:09.752285 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b4e21c-0e97-4668-a721-e3d9f6e4fb8e None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:09.806497 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd63e8c1-38d8-46ea-b009-4de600a1736e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:09.807186 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd63e8c1-38d8-46ea-b009-4de600a1736e None admin] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:09.807478 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd63e8c1-38d8-46ea-b009-4de600a1736e None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:09.807762 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd63e8c1-38d8-46ea-b009-4de600a1736e None admin] PATH_INFO: `/v3/endpoints` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:09.808570 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd63e8c1-38d8-46ea-b009-4de600a1736e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:09.809927 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd63e8c1-38d8-46ea-b009-4de600a1736e None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:09.834597 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 373/743] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Jul 15 20:38:09 2022] POST /identity/v3/endpoints => generated 327 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 20:38:10.737384 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c8fd7-058e-4c13-9b95-2bed1488d797 None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:10.737890 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c8fd7-058e-4c13-9b95-2bed1488d797 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:10.737890 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c8fd7-058e-4c13-9b95-2bed1488d797 None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:10.739281 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 371/744] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:38:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:38:10.744465 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b73d0f1-756b-4456-ad20-eff659b9f8be None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:10.744854 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b73d0f1-756b-4456-ad20-eff659b9f8be None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:10.745035 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b73d0f1-756b-4456-ad20-eff659b9f8be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:10.762106 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-8b73d0f1-756b-4456-ad20-eff659b9f8be None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:10.763274 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-8b73d0f1-756b-4456-ad20-eff659b9f8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:10.790653 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:10.845606 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 374/745] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:38:10 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 20:38:10.868520 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6c8fd7-058e-4c13-9b95-2bed1488d797 None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:10.972083 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6c8fd7-058e-4c13-9b95-2bed1488d797 None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:11.005218 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70405af-a0e8-480f-ab74-c01dc1718b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:11.005781 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70405af-a0e8-480f-ab74-c01dc1718b94 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:11.006061 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70405af-a0e8-480f-ab74-c01dc1718b94 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:11.006363 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70405af-a0e8-480f-ab74-c01dc1718b94 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:11.051306 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:11.073356 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70405af-a0e8-480f-ab74-c01dc1718b94 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:11.074823 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70405af-a0e8-480f-ab74-c01dc1718b94 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:11.177432 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 372/746] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jul 15 20:38:10 2022] GET /identity/v3/auth/tokens => generated 1396 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 20:38:11.178808 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b73d0f1-756b-4456-ad20-eff659b9f8be None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:11.277551 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b73d0f1-756b-4456-ad20-eff659b9f8be None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:11.313446 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33ecc84-7f12-442c-9512-0b2fab3eba7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:11.314270 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ecc84-7f12-442c-9512-0b2fab3eba7b None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:11.314558 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ecc84-7f12-442c-9512-0b2fab3eba7b None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:11.314825 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ecc84-7f12-442c-9512-0b2fab3eba7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:11.325030 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33ecc84-7f12-442c-9512-0b2fab3eba7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:11.327158 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33ecc84-7f12-442c-9512-0b2fab3eba7b None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:11.345065 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-d33ecc84-7f12-442c-9512-0b2fab3eba7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:38:11.345065 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:38:11.345065 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:38:11.345065 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:38:11.345065 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:38:11.345065 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:38:11.345065 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:38:11.345065 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:38:11.345065 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:38:11.345065 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:38:11.345065 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:38:11.345065 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:38:11.345065 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:38:11.345065 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:38:11.345065 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:38:11.346033 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:38:11.346033 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:38:11.346033 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:38:11.346033 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:38:11.346033 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:38:11.346033 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:38:11.346033 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:38:11.346033 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:38:11.346033 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:38:11.346033 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:38:11.346033 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:38:11.346033 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:38:11.346033 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:38:11.346033 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:38:11.346033 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:38:11.346033 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:38:11.346033 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:38:11.352032 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:38:11.352032 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:38:11.352032 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:38:11.352032 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:38:11.352032 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 375/747] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jul 15 20:38:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:38:11.352316 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70405af-a0e8-480f-ab74-c01dc1718b94 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:11.429951 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:11.457499 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70405af-a0e8-480f-ab74-c01dc1718b94 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:11.496369 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e081272-b4b0-497e-9f00-8087fc23f768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:11.496999 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e081272-b4b0-497e-9f00-8087fc23f768 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:11.497284 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e081272-b4b0-497e-9f00-8087fc23f768 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:11.497563 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e081272-b4b0-497e-9f00-8087fc23f768 None admin] PATH_INFO: `/v3/domains` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:11.498836 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e081272-b4b0-497e-9f00-8087fc23f768 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:38:11.499143 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e081272-b4b0-497e-9f00-8087fc23f768 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:11.500496 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e081272-b4b0-497e-9f00-8087fc23f768 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:11.512031 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 373/748] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jul 15 20:38:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:38:11.946882 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a6e0e-1496-4529-ab30-20c5b6a7bd97 None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:11.947467 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a6e0e-1496-4529-ab30-20c5b6a7bd97 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:11.947467 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a6e0e-1496-4529-ab30-20c5b6a7bd97 None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:11.948810 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 376/749] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:38:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:38:11.954206 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c681a7e-8326-42b4-9ca0-1c3bb72c27f7 None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:11.954613 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c681a7e-8326-42b4-9ca0-1c3bb72c27f7 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:11.954773 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c681a7e-8326-42b4-9ca0-1c3bb72c27f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:11.971263 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-3c681a7e-8326-42b4-9ca0-1c3bb72c27f7 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:11.972444 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-3c681a7e-8326-42b4-9ca0-1c3bb72c27f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:12.038448 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 374/750] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:38:11 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 20:38:12.039261 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f89ab-1c99-4fdd-94b8-7414f292177f None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:12.039673 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f89ab-1c99-4fdd-94b8-7414f292177f None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:12.040037 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f89ab-1c99-4fdd-94b8-7414f292177f None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:12.041457 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 377/751] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:38:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 20:38:12.047231 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e7334-976f-44eb-a62d-c319bf3d0764 None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:12.047524 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e7334-976f-44eb-a62d-c319bf3d0764 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:12.047809 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e7334-976f-44eb-a62d-c319bf3d0764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:12.062632 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6f89ab-1c99-4fdd-94b8-7414f292177f None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:12.064333 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-107e7334-976f-44eb-a62d-c319bf3d0764 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:12.065512 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-107e7334-976f-44eb-a62d-c319bf3d0764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:12.077514 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:12.127469 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:12.133456 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 375/752] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:38:12 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 20:38:12.156523 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107e7334-976f-44eb-a62d-c319bf3d0764 None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:12.164266 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6f89ab-1c99-4fdd-94b8-7414f292177f None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:12.200306 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56054a6-c0b0-4b8b-ad9e-b34e10d254e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:12.201060 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56054a6-c0b0-4b8b-ad9e-b34e10d254e7 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:12.201351 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56054a6-c0b0-4b8b-ad9e-b34e10d254e7 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:12.201636 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56054a6-c0b0-4b8b-ad9e-b34e10d254e7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:12.202324 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56054a6-c0b0-4b8b-ad9e-b34e10d254e7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:12.203700 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56054a6-c0b0-4b8b-ad9e-b34e10d254e7 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:12.215256 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-b56054a6-c0b0-4b8b-ad9e-b34e10d254e7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 15 20:38:12.215256 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:38:12.215256 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 20:38:12.215256 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 20:38:12.215256 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 20:38:12.215256 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 20:38:12.215256 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 20:38:12.215256 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:38:12.215256 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 15 20:38:12.215256 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:38:12.215256 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 20:38:12.215256 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:38:12.215256 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:38:12.215256 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:38:12.215256 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:38:12.215256 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:38:12.215256 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:38:12.216413 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:38:12.216413 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:38:12.216413 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:38:12.216413 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:38:12.216413 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:38:12.216413 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:38:12.216413 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 20:38:12.216413 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 20:38:12.216413 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 20:38:12.216413 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 20:38:12.216413 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:38:12.216413 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:38:12.216413 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:38:12.216413 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:38:12.216413 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:38:12.216413 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:38:12.217515 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:38:12.217515 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:38:12.217515 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:38:12.217515 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:38:12.217515 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:38:12.217515 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:38:12.217515 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:38:12.217515 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:38:12.217515 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:38:12.217515 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:38:12.217515 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 20:38:12.217515 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:38:12.217515 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 15 20:38:12.217515 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:38:12.219649 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 378/753] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Jul 15 20:38:12 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 20:38:12.225496 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56054a6-c0b0-4b8b-ad9e-b34e10d254e7 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:12.256861 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107e7334-976f-44eb-a62d-c319bf3d0764 None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:12.290032 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292b31bd-7f6b-4c71-ba5c-9c84255137c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:12.290862 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292b31bd-7f6b-4c71-ba5c-9c84255137c0 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:12.291153 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292b31bd-7f6b-4c71-ba5c-9c84255137c0 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:12.291432 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292b31bd-7f6b-4c71-ba5c-9c84255137c0 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:12.292083 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292b31bd-7f6b-4c71-ba5c-9c84255137c0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:12.293440 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292b31bd-7f6b-4c71-ba5c-9c84255137c0 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:12.300905 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:12.306183 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-292b31bd-7f6b-4c71-ba5c-9c84255137c0 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 15 20:38:12.306183 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:38:12.306183 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 20:38:12.306183 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 20:38:12.306183 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 20:38:12.306183 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 20:38:12.306183 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 20:38:12.306183 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:38:12.306183 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 15 20:38:12.306183 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:38:12.306183 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 20:38:12.306183 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:38:12.306183 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:38:12.306183 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:38:12.306183 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:38:12.306183 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:38:12.307182 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:38:12.307182 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:38:12.307182 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:38:12.307182 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:38:12.307182 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:38:12.307182 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:38:12.307182 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:38:12.307182 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 20:38:12.307182 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 20:38:12.307182 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 20:38:12.307182 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 20:38:12.307182 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:38:12.307182 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:38:12.307182 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:38:12.307182 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:38:12.307182 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:38:12.307998 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:38:12.307998 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:38:12.307998 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:38:12.307998 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:38:12.307998 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:38:12.307998 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:38:12.307998 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:38:12.307998 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:38:12.307998 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:38:12.307998 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:38:12.307998 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:38:12.307998 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 20:38:12.307998 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:38:12.307998 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 15 20:38:12.307998 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:38:12.307998 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 376/754] 10.222.0.16 () {56 vars in 1132 bytes} [Fri Jul 15 20:38:12 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 20:38:12.313286 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292b31bd-7f6b-4c71-ba5c-9c84255137c0 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:12.326142 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56054a6-c0b0-4b8b-ad9e-b34e10d254e7 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:12.371618 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35487727-e805-45c9-a0ce-95bc085da94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:12.372654 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35487727-e805-45c9-a0ce-95bc085da94f None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:12.373131 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35487727-e805-45c9-a0ce-95bc085da94f None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:12.373587 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35487727-e805-45c9-a0ce-95bc085da94f None admin] PATH_INFO: `/v3/services` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:12.374743 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35487727-e805-45c9-a0ce-95bc085da94f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:38:12.375179 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35487727-e805-45c9-a0ce-95bc085da94f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:12.376662 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35487727-e805-45c9-a0ce-95bc085da94f None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:12.381295 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 379/755] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Jul 15 20:38:12 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:38:12.383594 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:12.387548 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35487727-e805-45c9-a0ce-95bc085da94f None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:12.424683 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292b31bd-7f6b-4c71-ba5c-9c84255137c0 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:12.457683 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad6927-cab2-415f-95a7-2b363d26170d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:12.458307 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad6927-cab2-415f-95a7-2b363d26170d None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:12.458597 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad6927-cab2-415f-95a7-2b363d26170d None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:12.458877 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad6927-cab2-415f-95a7-2b363d26170d None admin] PATH_INFO: `/v3/services` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:12.459580 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aad6927-cab2-415f-95a7-2b363d26170d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:38:12.459896 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aad6927-cab2-415f-95a7-2b363d26170d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:12.461268 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aad6927-cab2-415f-95a7-2b363d26170d None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:12.466091 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 377/756] 10.222.0.16 () {56 vars in 1126 bytes} [Fri Jul 15 20:38:12 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:38:12.472139 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad6927-cab2-415f-95a7-2b363d26170d None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:12.490716 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35487727-e805-45c9-a0ce-95bc085da94f None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:12.523162 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebe339f-9f49-4ce8-9774-890b489dddd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:12.523820 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe339f-9f49-4ce8-9774-890b489dddd7 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:12.524108 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe339f-9f49-4ce8-9774-890b489dddd7 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:12.524393 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe339f-9f49-4ce8-9774-890b489dddd7 None admin] PATH_INFO: `/v3/services` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:12.525091 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebe339f-9f49-4ce8-9774-890b489dddd7 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:38:12.525399 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebe339f-9f49-4ce8-9774-890b489dddd7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:12.526791 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebe339f-9f49-4ce8-9774-890b489dddd7 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:12.533105 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 380/757] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Jul 15 20:38:12 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:38:12.580717 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad6927-cab2-415f-95a7-2b363d26170d None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:12.608565 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:12.617614 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4f6713-00de-4a5f-a757-780398b87e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:12.618324 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f6713-00de-4a5f-a757-780398b87e53 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:12.618615 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f6713-00de-4a5f-a757-780398b87e53 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:12.618892 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f6713-00de-4a5f-a757-780398b87e53 None admin] PATH_INFO: `/v3/services` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:12.619608 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4f6713-00de-4a5f-a757-780398b87e53 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:38:12.619918 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4f6713-00de-4a5f-a757-780398b87e53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:12.621298 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4f6713-00de-4a5f-a757-780398b87e53 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:12.626606 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 378/758] 10.222.0.16 () {56 vars in 1126 bytes} [Fri Jul 15 20:38:12 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:38:14.789387 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509f986-1bec-4587-a145-45ae9872266f None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:14.789884 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509f986-1bec-4587-a145-45ae9872266f None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:14.789884 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509f986-1bec-4587-a145-45ae9872266f None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:14.791245 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 381/759] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:38:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:38:14.796530 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16260883-8ed9-4f0d-809b-0af0f554223d None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:14.797460 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16260883-8ed9-4f0d-809b-0af0f554223d None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:14.797460 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16260883-8ed9-4f0d-809b-0af0f554223d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:14.814400 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-16260883-8ed9-4f0d-809b-0af0f554223d None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:14.815634 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-16260883-8ed9-4f0d-809b-0af0f554223d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:14.849475 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81921163-9e9b-45ce-8590-d41b47f66658 None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:14.849762 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81921163-9e9b-45ce-8590-d41b47f66658 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:14.850048 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81921163-9e9b-45ce-8590-d41b47f66658 None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:14.851429 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 382/760] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:38:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 20:38:14.856291 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e1c0a6-7700-4c68-8fc7-386496bc1924 None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:14.856875 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e1c0a6-7700-4c68-8fc7-386496bc1924 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:14.856875 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e1c0a6-7700-4c68-8fc7-386496bc1924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:14.863237 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:14.874786 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-d3e1c0a6-7700-4c68-8fc7-386496bc1924 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:14.875993 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-d3e1c0a6-7700-4c68-8fc7-386496bc1924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:14.889373 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 379/761] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:38:14 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 20:38:14.910118 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16260883-8ed9-4f0d-809b-0af0f554223d None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:14.943118 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 383/762] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:38:14 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 20:38:14.966846 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e1c0a6-7700-4c68-8fc7-386496bc1924 None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:15.012474 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16260883-8ed9-4f0d-809b-0af0f554223d None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:15.032184 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:15.047166 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b84a363-01aa-41c9-b018-3f55fb58fb5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:15.047833 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b84a363-01aa-41c9-b018-3f55fb58fb5e None admin] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:15.048127 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b84a363-01aa-41c9-b018-3f55fb58fb5e None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:15.048405 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b84a363-01aa-41c9-b018-3f55fb58fb5e None admin] PATH_INFO: `/v3/services` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:15.049110 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b84a363-01aa-41c9-b018-3f55fb58fb5e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:15.050594 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b84a363-01aa-41c9-b018-3f55fb58fb5e None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:15.063941 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 380/763] 10.222.0.16 () {60 vars in 1141 bytes} [Fri Jul 15 20:38:14 2022] POST /identity/v3/services => generated 251 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 20:38:15.067039 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e1c0a6-7700-4c68-8fc7-386496bc1924 None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:15.105531 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:15.113489 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3b501f-47fb-409c-a937-fb18381dab93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:15.114234 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3b501f-47fb-409c-a937-fb18381dab93 None admin] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:15.114522 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3b501f-47fb-409c-a937-fb18381dab93 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:15.114801 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3b501f-47fb-409c-a937-fb18381dab93 None admin] PATH_INFO: `/v3/services` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:15.115534 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3b501f-47fb-409c-a937-fb18381dab93 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:15.116958 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3b501f-47fb-409c-a937-fb18381dab93 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:15.133120 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 384/764] 10.222.0.16 () {60 vars in 1141 bytes} [Fri Jul 15 20:38:14 2022] POST /identity/v3/services => generated 269 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 20:38:17.422534 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f78368-76b9-482b-acc3-54efff32f56a None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:17.423097 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f78368-76b9-482b-acc3-54efff32f56a None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:17.423097 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f78368-76b9-482b-acc3-54efff32f56a None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:17.424450 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 381/765] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:38:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:38:17.429674 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b3acac-97ea-4223-a90c-c754190fc86d None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:17.430126 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b3acac-97ea-4223-a90c-c754190fc86d None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:17.430289 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b3acac-97ea-4223-a90c-c754190fc86d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:17.431957 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6839966-3698-41e2-af77-cb08f5427141 None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:17.432252 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6839966-3698-41e2-af77-cb08f5427141 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:17.432540 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6839966-3698-41e2-af77-cb08f5427141 None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:17.433801 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 382/766] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:38:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 20:38:17.438723 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f428dfe1-99de-46d9-b99a-49a84cc24ae4 None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:17.439018 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f428dfe1-99de-46d9-b99a-49a84cc24ae4 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:17.439303 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f428dfe1-99de-46d9-b99a-49a84cc24ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:17.447346 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-95b3acac-97ea-4223-a90c-c754190fc86d None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:17.448551 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-95b3acac-97ea-4223-a90c-c754190fc86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:17.456716 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-f428dfe1-99de-46d9-b99a-49a84cc24ae4 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:17.457964 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-f428dfe1-99de-46d9-b99a-49a84cc24ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:17.522801 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 385/767] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:38:17 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 20:38:17.525605 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 383/768] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:38:17 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 20:38:17.546751 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b3acac-97ea-4223-a90c-c754190fc86d None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:17.549594 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f428dfe1-99de-46d9-b99a-49a84cc24ae4 None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:17.645239 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b3acac-97ea-4223-a90c-c754190fc86d None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:17.648356 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f428dfe1-99de-46d9-b99a-49a84cc24ae4 None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:17.659231 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:17.661505 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:17.680322 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3fc3ea-1ed3-4bb3-8b26-0f625f81e0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:17.681051 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3fc3ea-1ed3-4bb3-8b26-0f625f81e0a3 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:17.681340 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3fc3ea-1ed3-4bb3-8b26-0f625f81e0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:17.681620 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3fc3ea-1ed3-4bb3-8b26-0f625f81e0a3 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:17.682319 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3fc3ea-1ed3-4bb3-8b26-0f625f81e0a3 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:17.683661 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3fc3ea-1ed3-4bb3-8b26-0f625f81e0a3 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:17.684215 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e27173c-9ff3-4783-9d92-9f4cf255c247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:17.685021 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27173c-9ff3-4783-9d92-9f4cf255c247 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:17.685854 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27173c-9ff3-4783-9d92-9f4cf255c247 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:17.686164 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27173c-9ff3-4783-9d92-9f4cf255c247 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:17.686818 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e27173c-9ff3-4783-9d92-9f4cf255c247 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:17.688159 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e27173c-9ff3-4783-9d92-9f4cf255c247 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:17.696026 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-9b3fc3ea-1ed3-4bb3-8b26-0f625f81e0a3 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 15 20:38:17.696026 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:38:17.696026 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 20:38:17.696026 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 20:38:17.696026 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 20:38:17.696026 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 20:38:17.696026 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 20:38:17.696026 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:38:17.696026 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 15 20:38:17.696026 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:38:17.696026 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 20:38:17.696026 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:38:17.696026 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:38:17.696026 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:38:17.696026 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:38:17.696026 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:38:17.696026 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:38:17.697102 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:38:17.697102 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:38:17.697102 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:38:17.697102 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:38:17.697102 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:38:17.697102 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:38:17.697102 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 20:38:17.697102 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 20:38:17.697102 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 20:38:17.697102 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 20:38:17.697102 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:38:17.697102 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:38:17.697102 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:38:17.697102 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:38:17.697102 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:38:17.697102 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:38:17.697914 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:38:17.697914 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:38:17.697914 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:38:17.697914 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:38:17.697914 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:38:17.697914 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:38:17.697914 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:38:17.697914 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:38:17.697914 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:38:17.697914 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:38:17.697914 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 20:38:17.697914 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:38:17.697914 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 15 20:38:17.697914 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:38:17.697914 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 386/769] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Jul 15 20:38:17 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:38:17.700308 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-6e27173c-9ff3-4783-9d92-9f4cf255c247 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 15 20:38:17.700308 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:38:17.700308 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 20:38:17.700308 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 20:38:17.700308 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 20:38:17.700308 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 20:38:17.700308 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 20:38:17.700308 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:38:17.700308 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 15 20:38:17.700308 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:38:17.700308 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 20:38:17.700308 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:38:17.700308 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:38:17.700308 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:38:17.700308 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:38:17.700308 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:38:17.701951 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:38:17.701951 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:38:17.701951 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:38:17.701951 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:38:17.701951 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:38:17.701951 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:38:17.701951 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:38:17.701951 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 20:38:17.701951 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 20:38:17.701951 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 20:38:17.701951 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 20:38:17.701951 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:38:17.701951 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:38:17.701951 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:38:17.701951 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:38:17.701951 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:38:17.703230 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:38:17.703230 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:38:17.703230 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:38:17.703230 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:38:17.703230 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:38:17.703230 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:38:17.703230 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:38:17.703230 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:38:17.703230 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:38:17.703230 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:38:17.703230 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:38:17.703230 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 20:38:17.703230 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:38:17.703230 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 15 20:38:17.703230 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:38:17.703230 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 384/770] 10.222.0.16 () {56 vars in 1132 bytes} [Fri Jul 15 20:38:17 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:38:17.704362 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3fc3ea-1ed3-4bb3-8b26-0f625f81e0a3 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:17.707728 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e27173c-9ff3-4783-9d92-9f4cf255c247 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:17.801784 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3fc3ea-1ed3-4bb3-8b26-0f625f81e0a3 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:17.805849 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e27173c-9ff3-4783-9d92-9f4cf255c247 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:17.839271 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47e03e-0ef9-473f-868f-91d334efdcc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:17.839935 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47e03e-0ef9-473f-868f-91d334efdcc0 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:17.840226 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47e03e-0ef9-473f-868f-91d334efdcc0 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:17.840498 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47e03e-0ef9-473f-868f-91d334efdcc0 None admin] PATH_INFO: `/v3/services` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:17.841356 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c47e03e-0ef9-473f-868f-91d334efdcc0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:38:17.841686 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c47e03e-0ef9-473f-868f-91d334efdcc0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:17.843080 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c47e03e-0ef9-473f-868f-91d334efdcc0 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:17.843351 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef595f7-afd3-4389-9a1b-0bc01211c92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:17.844008 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef595f7-afd3-4389-9a1b-0bc01211c92a None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:17.844290 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef595f7-afd3-4389-9a1b-0bc01211c92a None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:17.844561 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef595f7-afd3-4389-9a1b-0bc01211c92a None admin] PATH_INFO: `/v3/services` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:17.845253 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef595f7-afd3-4389-9a1b-0bc01211c92a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:38:17.845557 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef595f7-afd3-4389-9a1b-0bc01211c92a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:17.846919 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef595f7-afd3-4389-9a1b-0bc01211c92a None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:17.848102 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 387/771] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Jul 15 20:38:17 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:38:17.856065 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 385/772] 10.222.0.16 () {56 vars in 1126 bytes} [Fri Jul 15 20:38:17 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:38:17.856248 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47e03e-0ef9-473f-868f-91d334efdcc0 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:17.856988 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef595f7-afd3-4389-9a1b-0bc01211c92a None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:17.896199 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:17.898884 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:17.952847 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47e03e-0ef9-473f-868f-91d334efdcc0 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:17.955060 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef595f7-afd3-4389-9a1b-0bc01211c92a None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:17.985504 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a786ba68-36e3-421d-9dfa-f19b75e7e234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:17.986198 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a786ba68-36e3-421d-9dfa-f19b75e7e234 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:17.986487 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a786ba68-36e3-421d-9dfa-f19b75e7e234 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:17.986766 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a786ba68-36e3-421d-9dfa-f19b75e7e234 None admin] PATH_INFO: `/v3/services` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:17.987467 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a786ba68-36e3-421d-9dfa-f19b75e7e234 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:38:17.987777 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a786ba68-36e3-421d-9dfa-f19b75e7e234 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:17.988338 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35268ac3-627a-4564-b9f0-a6ba3c2ff062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:17.988993 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35268ac3-627a-4564-b9f0-a6ba3c2ff062 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:17.989137 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a786ba68-36e3-421d-9dfa-f19b75e7e234 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:17.989281 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35268ac3-627a-4564-b9f0-a6ba3c2ff062 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:17.989560 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35268ac3-627a-4564-b9f0-a6ba3c2ff062 None admin] PATH_INFO: `/v3/services` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:17.990292 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35268ac3-627a-4564-b9f0-a6ba3c2ff062 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:38:17.990598 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35268ac3-627a-4564-b9f0-a6ba3c2ff062 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:17.991940 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35268ac3-627a-4564-b9f0-a6ba3c2ff062 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:17.993908 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 388/773] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Jul 15 20:38:17 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:38:17.996787 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 386/774] 10.222.0.16 () {56 vars in 1126 bytes} [Fri Jul 15 20:38:17 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:38:18.000265 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a786ba68-36e3-421d-9dfa-f19b75e7e234 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:18.002795 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35268ac3-627a-4564-b9f0-a6ba3c2ff062 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:18.097284 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a786ba68-36e3-421d-9dfa-f19b75e7e234 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:18.100269 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35268ac3-627a-4564-b9f0-a6ba3c2ff062 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:18.101790 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:18.106028 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:18.134870 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4310128b-cef5-4128-b2b2-f11c7e7b4f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:18.135530 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4310128b-cef5-4128-b2b2-f11c7e7b4f5b None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:18.135820 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4310128b-cef5-4128-b2b2-f11c7e7b4f5b None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:18.136104 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4310128b-cef5-4128-b2b2-f11c7e7b4f5b None admin] PATH_INFO: `/v3/endpoints` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:18.136889 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4310128b-cef5-4128-b2b2-f11c7e7b4f5b None admin] RBAC: Adding query filter params (interface=public, service_id=2499a6af219b4ad4b422f3b9444c22a7, region_id=RegionOne) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:38:18.137207 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4310128b-cef5-4128-b2b2-f11c7e7b4f5b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:18.137478 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddae00f-84a9-4ccd-8a54-576517f4d2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:18.138151 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddae00f-84a9-4ccd-8a54-576517f4d2b5 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:18.138563 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddae00f-84a9-4ccd-8a54-576517f4d2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:18.138695 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4310128b-cef5-4128-b2b2-f11c7e7b4f5b None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:18.138838 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddae00f-84a9-4ccd-8a54-576517f4d2b5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:18.139616 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddae00f-84a9-4ccd-8a54-576517f4d2b5 None admin] RBAC: Adding query filter params (interface=public, service_id=6a40322f1f974405b2e20c9db065bcf7, region_id=RegionOne) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:38:18.139933 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddae00f-84a9-4ccd-8a54-576517f4d2b5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:18.141270 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddae00f-84a9-4ccd-8a54-576517f4d2b5 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:18.143847 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 389/775] 10.222.0.16 () {56 vars in 1251 bytes} [Fri Jul 15 20:38:17 2022] GET /identity/v3/endpoints?service_id=2499a6af219b4ad4b422f3b9444c22a7&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:38:18.148257 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 387/776] 10.222.0.16 () {56 vars in 1251 bytes} [Fri Jul 15 20:38:18 2022] GET /identity/v3/endpoints?service_id=6a40322f1f974405b2e20c9db065bcf7&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:38:18.151561 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddae00f-84a9-4ccd-8a54-576517f4d2b5 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:18.151682 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4310128b-cef5-4128-b2b2-f11c7e7b4f5b None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:18.251037 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddae00f-84a9-4ccd-8a54-576517f4d2b5 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:18.251565 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4310128b-cef5-4128-b2b2-f11c7e7b4f5b None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:18.284478 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb58de3d-6d85-4834-826a-446e21fb1ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:18.284737 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d1457c-63e8-4b5d-b815-3a52c505cf17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:18.285134 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58de3d-6d85-4834-826a-446e21fb1ea3 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:18.285387 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d1457c-63e8-4b5d-b815-3a52c505cf17 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:18.285482 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58de3d-6d85-4834-826a-446e21fb1ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:18.285676 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d1457c-63e8-4b5d-b815-3a52c505cf17 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:18.285763 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58de3d-6d85-4834-826a-446e21fb1ea3 None admin] PATH_INFO: `/v3/services` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:18.285954 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d1457c-63e8-4b5d-b815-3a52c505cf17 None admin] PATH_INFO: `/v3/services` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:18.286381 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb58de3d-6d85-4834-826a-446e21fb1ea3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:18.286665 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d1457c-63e8-4b5d-b815-3a52c505cf17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:18.287754 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb58de3d-6d85-4834-826a-446e21fb1ea3 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:18.288007 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d1457c-63e8-4b5d-b815-3a52c505cf17 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:18.293490 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 390/777] 10.222.0.16 () {56 vars in 1087 bytes} [Fri Jul 15 20:38:18 2022] GET /identity/v3/services => generated 1498 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:38:18.299870 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 388/778] 10.222.0.16 () {56 vars in 1087 bytes} [Fri Jul 15 20:38:18 2022] GET /identity/v3/services => generated 1498 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:38:20.551778 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c914d73-2094-49a3-8545-d842c9eec1f8 None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:20.552353 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c914d73-2094-49a3-8545-d842c9eec1f8 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:20.552353 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c914d73-2094-49a3-8545-d842c9eec1f8 None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:20.553689 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 391/779] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:38:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:38:20.559076 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa8a40-0c85-4fb8-82ee-cd5edc572c36 None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:20.559504 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa8a40-0c85-4fb8-82ee-cd5edc572c36 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:20.559749 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa8a40-0c85-4fb8-82ee-cd5edc572c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:20.560708 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a440ab-9965-4f76-9775-64c0d67aca54 None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:20.560999 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a440ab-9965-4f76-9775-64c0d67aca54 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:20.561286 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a440ab-9965-4f76-9775-64c0d67aca54 None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:20.562589 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 392/780] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:38:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 20:38:20.567321 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd282c-f039-4b5f-8756-3f5be1af5ad4 None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:20.567608 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd282c-f039-4b5f-8756-3f5be1af5ad4 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:20.567885 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd282c-f039-4b5f-8756-3f5be1af5ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:20.577003 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-05fa8a40-0c85-4fb8-82ee-cd5edc572c36 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:20.578274 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-05fa8a40-0c85-4fb8-82ee-cd5edc572c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:20.606368 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:20.653386 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 389/781] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:38:20 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 20:38:20.678635 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fa8a40-0c85-4fb8-82ee-cd5edc572c36 None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:20.700702 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-2fcd282c-f039-4b5f-8756-3f5be1af5ad4 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:20.701948 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-2fcd282c-f039-4b5f-8756-3f5be1af5ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:20.730419 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:20.768496 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 393/782] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:38:20 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 20:38:20.779689 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fa8a40-0c85-4fb8-82ee-cd5edc572c36 None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:20.792794 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd282c-f039-4b5f-8756-3f5be1af5ad4 None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:20.814836 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a31a30-e42d-4114-a8b9-604f0886db9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:20.815627 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a31a30-e42d-4114-a8b9-604f0886db9e None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:20.815922 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a31a30-e42d-4114-a8b9-604f0886db9e None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:20.816204 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a31a30-e42d-4114-a8b9-604f0886db9e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:20.816859 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a31a30-e42d-4114-a8b9-604f0886db9e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:20.818262 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a31a30-e42d-4114-a8b9-604f0886db9e None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:20.830143 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-95a31a30-e42d-4114-a8b9-604f0886db9e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 15 20:38:20.830143 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:38:20.830143 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 20:38:20.830143 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 20:38:20.830143 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 20:38:20.830143 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 20:38:20.830143 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 20:38:20.830143 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:38:20.830143 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 15 20:38:20.830143 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:38:20.830143 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 20:38:20.830143 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:38:20.830143 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:38:20.830143 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:38:20.830143 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:38:20.830143 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:38:20.830143 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:38:20.831286 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:38:20.831286 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:38:20.831286 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:38:20.831286 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:38:20.831286 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:38:20.831286 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:38:20.831286 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 20:38:20.831286 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 20:38:20.831286 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 20:38:20.831286 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 20:38:20.831286 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:38:20.831286 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:38:20.831286 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:38:20.831286 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:38:20.831286 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:38:20.831286 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:38:20.832208 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:38:20.832208 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:38:20.832208 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:38:20.832208 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:38:20.832208 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:38:20.832208 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:38:20.832208 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:38:20.832208 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:38:20.832208 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:38:20.832208 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:38:20.832208 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 20:38:20.832208 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:38:20.832208 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 15 20:38:20.832208 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:38:20.832208 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 390/783] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Jul 15 20:38:20 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 20:38:20.837058 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a31a30-e42d-4114-a8b9-604f0886db9e None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:20.864436 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:20.894480 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd282c-f039-4b5f-8756-3f5be1af5ad4 None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:20.927462 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c3cb52-0f6e-465e-a9af-5236c5cbf99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:20.928324 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3cb52-0f6e-465e-a9af-5236c5cbf99d None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:20.928618 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3cb52-0f6e-465e-a9af-5236c5cbf99d None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:20.928899 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3cb52-0f6e-465e-a9af-5236c5cbf99d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:20.929554 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c3cb52-0f6e-465e-a9af-5236c5cbf99d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:20.930978 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c3cb52-0f6e-465e-a9af-5236c5cbf99d None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:20.939586 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a31a30-e42d-4114-a8b9-604f0886db9e None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:20.943457 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-b2c3cb52-0f6e-465e-a9af-5236c5cbf99d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 15 20:38:20.943457 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:38:20.943457 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 20:38:20.943457 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 20:38:20.943457 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 20:38:20.943457 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 20:38:20.943457 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 20:38:20.943457 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:38:20.943457 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 15 20:38:20.943457 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:38:20.943457 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 20:38:20.943457 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:38:20.943457 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:38:20.943457 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:38:20.943457 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:38:20.943457 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:38:20.944513 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:38:20.944513 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:38:20.944513 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:38:20.944513 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:38:20.944513 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:38:20.944513 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:38:20.944513 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:38:20.944513 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 20:38:20.944513 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 20:38:20.944513 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 20:38:20.944513 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 20:38:20.944513 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:38:20.944513 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:38:20.944513 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:38:20.944513 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:38:20.944513 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:38:20.945636 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:38:20.945636 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:38:20.945636 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:38:20.945636 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:38:20.945636 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:38:20.945636 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:38:20.945636 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:38:20.945636 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:38:20.945636 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:38:20.945636 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:38:20.945636 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:38:20.945636 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 20:38:20.945636 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:38:20.945636 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 15 20:38:20.945636 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:38:20.945636 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 394/784] 10.222.0.16 () {56 vars in 1132 bytes} [Fri Jul 15 20:38:20 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 20:38:20.951614 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c3cb52-0f6e-465e-a9af-5236c5cbf99d None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:20.974584 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee54d0b1-f4f6-4830-8228-a4a0d1ccfccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:20.975246 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee54d0b1-f4f6-4830-8228-a4a0d1ccfccb None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:20.975542 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee54d0b1-f4f6-4830-8228-a4a0d1ccfccb None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:20.975825 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee54d0b1-f4f6-4830-8228-a4a0d1ccfccb None admin] PATH_INFO: `/v3/services` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:20.976531 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee54d0b1-f4f6-4830-8228-a4a0d1ccfccb None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:38:20.976844 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee54d0b1-f4f6-4830-8228-a4a0d1ccfccb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:20.978240 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee54d0b1-f4f6-4830-8228-a4a0d1ccfccb None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:20.981484 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:20.987518 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 391/785] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Jul 15 20:38:20 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:38:20.988662 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee54d0b1-f4f6-4830-8228-a4a0d1ccfccb None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:21.054148 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c3cb52-0f6e-465e-a9af-5236c5cbf99d None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:21.073306 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:21.086562 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee54d0b1-f4f6-4830-8228-a4a0d1ccfccb None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:21.087823 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5281d0-90f9-46db-9cd0-8c42996057cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:21.088488 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5281d0-90f9-46db-9cd0-8c42996057cb None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:21.088782 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5281d0-90f9-46db-9cd0-8c42996057cb None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:21.089062 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5281d0-90f9-46db-9cd0-8c42996057cb None admin] PATH_INFO: `/v3/services` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:21.089768 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5281d0-90f9-46db-9cd0-8c42996057cb None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:38:21.090104 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5281d0-90f9-46db-9cd0-8c42996057cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:21.092039 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5281d0-90f9-46db-9cd0-8c42996057cb None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:21.096846 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 395/786] 10.222.0.16 () {56 vars in 1126 bytes} [Fri Jul 15 20:38:20 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:38:21.102411 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5281d0-90f9-46db-9cd0-8c42996057cb None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:21.123992 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76498cf6-7d2a-44ab-ad30-4b2421ddbb86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:21.124650 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76498cf6-7d2a-44ab-ad30-4b2421ddbb86 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:21.124941 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76498cf6-7d2a-44ab-ad30-4b2421ddbb86 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:21.125225 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76498cf6-7d2a-44ab-ad30-4b2421ddbb86 None admin] PATH_INFO: `/v3/services` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:21.125929 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76498cf6-7d2a-44ab-ad30-4b2421ddbb86 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:38:21.126275 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76498cf6-7d2a-44ab-ad30-4b2421ddbb86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:21.127645 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76498cf6-7d2a-44ab-ad30-4b2421ddbb86 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:21.132364 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 392/787] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Jul 15 20:38:20 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:38:21.137829 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76498cf6-7d2a-44ab-ad30-4b2421ddbb86 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:21.192647 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:21.199518 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5281d0-90f9-46db-9cd0-8c42996057cb None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:21.233281 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e312bf-c2dc-4182-8259-2ff66f06115d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:21.233895 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e312bf-c2dc-4182-8259-2ff66f06115d None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:21.234200 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e312bf-c2dc-4182-8259-2ff66f06115d None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:21.234485 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e312bf-c2dc-4182-8259-2ff66f06115d None admin] PATH_INFO: `/v3/services` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:21.235182 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e312bf-c2dc-4182-8259-2ff66f06115d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:38:21.235492 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e312bf-c2dc-4182-8259-2ff66f06115d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:21.236849 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e312bf-c2dc-4182-8259-2ff66f06115d None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:21.237164 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76498cf6-7d2a-44ab-ad30-4b2421ddbb86 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:21.241502 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 396/788] 10.222.0.16 () {56 vars in 1126 bytes} [Fri Jul 15 20:38:21 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:38:21.247073 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e312bf-c2dc-4182-8259-2ff66f06115d None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:21.271688 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07999a7a-309f-4787-9230-da87c1c1e735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:21.272339 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07999a7a-309f-4787-9230-da87c1c1e735 None admin] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:21.272625 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07999a7a-309f-4787-9230-da87c1c1e735 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:21.272916 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07999a7a-309f-4787-9230-da87c1c1e735 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:21.273649 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07999a7a-309f-4787-9230-da87c1c1e735 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:21.275170 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07999a7a-309f-4787-9230-da87c1c1e735 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:21.292986 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 393/789] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Jul 15 20:38:21 2022] POST /identity/v3/endpoints => generated 346 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 20:38:21.351330 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e312bf-c2dc-4182-8259-2ff66f06115d None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:21.393451 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9186d0-6020-4ed1-b4e4-8da4bbf2d656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:21.394147 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9186d0-6020-4ed1-b4e4-8da4bbf2d656 None admin] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:21.394432 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9186d0-6020-4ed1-b4e4-8da4bbf2d656 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:21.394708 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9186d0-6020-4ed1-b4e4-8da4bbf2d656 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:21.395439 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9186d0-6020-4ed1-b4e4-8da4bbf2d656 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:21.396824 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9186d0-6020-4ed1-b4e4-8da4bbf2d656 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:21.416998 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 397/790] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Jul 15 20:38:21 2022] POST /identity/v3/endpoints => generated 347 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 20:38:23.545614 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d5e206-f7e1-40eb-8c86-a2a788fb0997 None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:23.546169 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d5e206-f7e1-40eb-8c86-a2a788fb0997 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:23.546291 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d5e206-f7e1-40eb-8c86-a2a788fb0997 None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:23.547541 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 394/791] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:38:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:38:23.552840 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d24d7-eb78-4c28-98f4-1d0887125a15 None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:23.553246 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d24d7-eb78-4c28-98f4-1d0887125a15 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:23.553399 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d24d7-eb78-4c28-98f4-1d0887125a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:23.570115 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-a11d24d7-eb78-4c28-98f4-1d0887125a15 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:23.571282 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-a11d24d7-eb78-4c28-98f4-1d0887125a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:23.573946 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:23.642751 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 398/792] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:38:23 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 20:38:23.652427 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ed65e-0a33-4b32-b425-0678bf0a8b74 None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:23.652720 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ed65e-0a33-4b32-b425-0678bf0a8b74 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:23.653002 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ed65e-0a33-4b32-b425-0678bf0a8b74 None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:23.654895 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 395/793] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:38:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:38:23.660122 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e4b2ce-a5b5-4487-a668-2b0fc5d93575 None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:23.660413 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e4b2ce-a5b5-4487-a668-2b0fc5d93575 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:23.660690 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e4b2ce-a5b5-4487-a668-2b0fc5d93575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:23.667044 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944ed65e-0a33-4b32-b425-0678bf0a8b74 None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:23.678397 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-b5e4b2ce-a5b5-4487-a668-2b0fc5d93575 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:23.678724 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:23.679786 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-b5e4b2ce-a5b5-4487-a668-2b0fc5d93575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:23.745446 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 399/794] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:38:23 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 20:38:23.768337 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e4b2ce-a5b5-4487-a668-2b0fc5d93575 None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:23.768633 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944ed65e-0a33-4b32-b425-0678bf0a8b74 None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:23.803027 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07805e42-5071-4229-bc61-bd7d38e05427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:23.803672 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07805e42-5071-4229-bc61-bd7d38e05427 None admin] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:23.803958 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07805e42-5071-4229-bc61-bd7d38e05427 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:23.804233 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07805e42-5071-4229-bc61-bd7d38e05427 None admin] PATH_INFO: `/v3/projects` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:23.804919 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07805e42-5071-4229-bc61-bd7d38e05427 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:23.806368 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07805e42-5071-4229-bc61-bd7d38e05427 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:23.807707 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: WARNING keystone.server.flask.common [None req-07805e42-5071-4229-bc61-bd7d38e05427 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 15 20:38:23.824366 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.sql.core [None req-07805e42-5071-4229-bc61-bd7d38e05427 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 15 20:38:23.824366 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 15 20:38:23.824366 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [parameters: {'id': '3238aeb5563c4c778fef70e586a19064', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 15 20:38:23.824366 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=98951) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 15 20:38:23.832060 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:23.842914 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-07805e42-5071-4229-bc61-bd7d38e05427 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3238aeb5563c4c778fef70e586a19064.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3238aeb5563c4c778fef70e586a19064. Jul 15 20:38:23.842914 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:38:23.842914 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 15 20:38:23.842914 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 15 20:38:23.842914 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 15 20:38:23.842914 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 15 20:38:23.842914 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 15 20:38:23.842914 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application result = self._query(query) Jul 15 20:38:23.842914 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 15 20:38:23.842914 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application conn.query(q) Jul 15 20:38:23.842914 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 15 20:38:23.842914 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 15 20:38:23.842914 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 15 20:38:23.843815 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application result.read() Jul 15 20:38:23.843815 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 15 20:38:23.843815 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 15 20:38:23.843815 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 15 20:38:23.843815 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 15 20:38:23.843815 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 15 20:38:23.843815 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 15 20:38:23.843815 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 15 20:38:23.843815 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 15 20:38:23.843815 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 15 20:38:23.843815 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:38:23.843815 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 15 20:38:23.843815 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:38:23.843815 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:38:23.843815 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 15 20:38:23.843815 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 15 20:38:23.843815 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 15 20:38:23.843815 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 15 20:38:23.844992 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 15 20:38:23.844992 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application next(self.gen) Jul 15 20:38:23.844992 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 15 20:38:23.844992 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application yield resource Jul 15 20:38:23.844992 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 15 20:38:23.844992 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application next(self.gen) Jul 15 20:38:23.844992 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 15 20:38:23.844992 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application self.session.rollback() Jul 15 20:38:23.844992 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 15 20:38:23.844992 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application self.force_reraise() Jul 15 20:38:23.844992 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 15 20:38:23.844992 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise self.value Jul 15 20:38:23.844992 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 15 20:38:23.844992 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 15 20:38:23.844992 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 15 20:38:23.844992 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application session.commit() Jul 15 20:38:23.844992 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 15 20:38:23.846437 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 15 20:38:23.846437 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 15 20:38:23.846437 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application self._prepare_impl() Jul 15 20:38:23.846437 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 15 20:38:23.846437 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application self.session.flush() Jul 15 20:38:23.846437 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 15 20:38:23.846437 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application self._flush(objects) Jul 15 20:38:23.846437 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 15 20:38:23.846437 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 15 20:38:23.846437 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 15 20:38:23.846437 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application compat.raise_( Jul 15 20:38:23.846437 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 15 20:38:23.846437 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception Jul 15 20:38:23.846437 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 15 20:38:23.846437 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application flush_context.execute() Jul 15 20:38:23.846437 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 15 20:38:23.846437 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rec.execute(self) Jul 15 20:38:23.847414 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 15 20:38:23.847414 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 15 20:38:23.847414 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 15 20:38:23.847414 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 15 20:38:23.847414 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 15 20:38:23.847414 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 15 20:38:23.847414 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 15 20:38:23.847414 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 15 20:38:23.847414 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 15 20:38:23.847414 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 15 20:38:23.847414 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 15 20:38:23.847414 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 15 20:38:23.847414 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 15 20:38:23.847414 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 15 20:38:23.847414 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 15 20:38:23.848255 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 15 20:38:23.848255 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 15 20:38:23.848255 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception Jul 15 20:38:23.848255 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 15 20:38:23.848255 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 15 20:38:23.848255 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 15 20:38:23.848255 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 15 20:38:23.848255 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 15 20:38:23.848255 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application result = self._query(query) Jul 15 20:38:23.848255 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 15 20:38:23.848255 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application conn.query(q) Jul 15 20:38:23.848255 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 15 20:38:23.848255 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 15 20:38:23.848255 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 15 20:38:23.848255 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application result.read() Jul 15 20:38:23.848255 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 15 20:38:23.848255 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 15 20:38:23.850146 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 15 20:38:23.850146 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 15 20:38:23.850146 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 15 20:38:23.850146 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 15 20:38:23.850146 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 15 20:38:23.850146 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 15 20:38:23.850146 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 15 20:38:23.850146 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 15 20:38:23.850146 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [parameters: {'id': '3238aeb5563c4c778fef70e586a19064', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 15 20:38:23.850146 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 15 20:38:23.850146 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:38:23.850146 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 20:38:23.850146 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:38:23.850146 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:38:23.850146 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 15 20:38:23.852086 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 15 20:38:23.852086 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 15 20:38:23.852086 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 15 20:38:23.852086 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 15 20:38:23.852086 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:38:23.852086 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 20:38:23.852086 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:38:23.852086 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:38:23.852086 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:38:23.852086 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:38:23.852086 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:38:23.852086 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:38:23.852086 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:38:23.852086 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:38:23.852086 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:38:23.852086 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:38:23.852086 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:38:23.854009 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:38:23.854009 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 15 20:38:23.854009 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 15 20:38:23.854009 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:38:23.854009 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:38:23.854009 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 15 20:38:23.854009 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 15 20:38:23.854009 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3238aeb5563c4c778fef70e586a19064. Jul 15 20:38:23.854009 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:38:23.854009 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 396/795] 10.222.0.16 () {60 vars in 1140 bytes} [Fri Jul 15 20:38:23 2022] POST /identity/v3/projects => generated 262 bytes in 178 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 15 20:38:23.854009 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07805e42-5071-4229-bc61-bd7d38e05427 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:23.869748 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e4b2ce-a5b5-4487-a668-2b0fc5d93575 None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:23.905459 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4d0b6a-9594-435b-b2bf-bee995cd4165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:23.906545 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d0b6a-9594-435b-b2bf-bee995cd4165 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:23.906829 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d0b6a-9594-435b-b2bf-bee995cd4165 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:23.907105 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d0b6a-9594-435b-b2bf-bee995cd4165 None admin] PATH_INFO: `/v3/services/compute` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:23.907751 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4d0b6a-9594-435b-b2bf-bee995cd4165 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:23.909113 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4d0b6a-9594-435b-b2bf-bee995cd4165 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:23.917373 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:23.921588 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-cd4d0b6a-9594-435b-b2bf-bee995cd4165 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 15 20:38:23.921588 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:38:23.921588 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 20:38:23.921588 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 20:38:23.921588 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 20:38:23.921588 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 20:38:23.921588 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 20:38:23.921588 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:38:23.921588 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 15 20:38:23.921588 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:38:23.921588 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 20:38:23.921588 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:38:23.921588 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:38:23.921588 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:38:23.921588 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:38:23.921588 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:38:23.921588 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:38:23.922569 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:38:23.922569 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:38:23.922569 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:38:23.922569 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:38:23.922569 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:38:23.922569 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:38:23.922569 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 20:38:23.922569 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 20:38:23.922569 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 20:38:23.922569 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 20:38:23.922569 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:38:23.922569 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:38:23.922569 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:38:23.922569 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:38:23.922569 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:38:23.922569 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:38:23.923388 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:38:23.923388 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:38:23.923388 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:38:23.923388 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:38:23.923388 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:38:23.923388 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:38:23.923388 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:38:23.923388 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:38:23.923388 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:38:23.923388 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:38:23.923388 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 20:38:23.923388 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:38:23.923388 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 15 20:38:23.923388 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:38:23.923388 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 400/796] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jul 15 20:38:23 2022] GET /identity/v3/services/compute => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 20:38:23.928834 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4d0b6a-9594-435b-b2bf-bee995cd4165 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:23.959143 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07805e42-5071-4229-bc61-bd7d38e05427 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:23.992382 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76080adc-dc5d-47c7-932c-61f122310029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:23.993201 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76080adc-dc5d-47c7-932c-61f122310029 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:23.993493 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76080adc-dc5d-47c7-932c-61f122310029 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:23.993773 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76080adc-dc5d-47c7-932c-61f122310029 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:24.001032 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76080adc-dc5d-47c7-932c-61f122310029 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:24.002655 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76080adc-dc5d-47c7-932c-61f122310029 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:24.016297 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-76080adc-dc5d-47c7-932c-61f122310029 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:38:24.016297 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:38:24.016297 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:38:24.016297 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:38:24.016297 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:38:24.016297 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:38:24.016297 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:38:24.016297 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:38:24.016297 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:38:24.016297 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:38:24.016297 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:38:24.016297 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:38:24.016297 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 20:38:24.016297 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 20:38:24.016297 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 20:38:24.017218 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 20:38:24.017218 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:38:24.017218 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:38:24.017218 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:38:24.017218 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:38:24.017218 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:38:24.017218 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:38:24.017218 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:38:24.017218 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:38:24.017218 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:38:24.017218 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:38:24.017218 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:38:24.017218 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:38:24.017218 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:38:24.017218 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:38:24.017218 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:38:24.017218 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:38:24.018110 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 20:38:24.018110 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 20:38:24.018110 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 20:38:24.018110 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 20:38:24.018110 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 20:38:24.018110 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 20:38:24.018110 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:38:24.018110 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:38:24.018110 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 397/797] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jul 15 20:38:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 20:38:24.023343 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76080adc-dc5d-47c7-932c-61f122310029 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:24.028204 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4d0b6a-9594-435b-b2bf-bee995cd4165 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:24.055999 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:24.062851 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb279dd-8f1b-4ff4-9d5e-e22618cd68fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:24.063613 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb279dd-8f1b-4ff4-9d5e-e22618cd68fd None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:24.063914 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb279dd-8f1b-4ff4-9d5e-e22618cd68fd None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:24.064198 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb279dd-8f1b-4ff4-9d5e-e22618cd68fd None admin] PATH_INFO: `/v3/services` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:24.064906 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb279dd-8f1b-4ff4-9d5e-e22618cd68fd None admin] RBAC: Adding query filter params (name=compute) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:38:24.065219 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb279dd-8f1b-4ff4-9d5e-e22618cd68fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:24.066638 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb279dd-8f1b-4ff4-9d5e-e22618cd68fd None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:24.071709 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 401/798] 10.222.0.16 () {56 vars in 1112 bytes} [Fri Jul 15 20:38:23 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:38:24.077660 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb279dd-8f1b-4ff4-9d5e-e22618cd68fd None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:24.126855 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76080adc-dc5d-47c7-932c-61f122310029 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:24.149910 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:24.161470 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bfcc7b-2efa-4fc9-ad09-74ee5d853fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:24.162142 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bfcc7b-2efa-4fc9-ad09-74ee5d853fb4 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:24.162426 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bfcc7b-2efa-4fc9-ad09-74ee5d853fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:24.162699 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bfcc7b-2efa-4fc9-ad09-74ee5d853fb4 None admin] PATH_INFO: `/v3/projects` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:24.163439 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bfcc7b-2efa-4fc9-ad09-74ee5d853fb4 None admin] RBAC: Adding query filter params (name=service) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:38:24.163744 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bfcc7b-2efa-4fc9-ad09-74ee5d853fb4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:24.165166 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bfcc7b-2efa-4fc9-ad09-74ee5d853fb4 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:24.176393 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb279dd-8f1b-4ff4-9d5e-e22618cd68fd None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:24.184567 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 398/799] 10.222.0.16 () {56 vars in 1112 bytes} [Fri Jul 15 20:38:24 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:38:24.211310 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78885c3-a95e-4030-8972-2ca0aa3db9d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:24.211994 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78885c3-a95e-4030-8972-2ca0aa3db9d8 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:24.212281 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78885c3-a95e-4030-8972-2ca0aa3db9d8 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:24.212562 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78885c3-a95e-4030-8972-2ca0aa3db9d8 None admin] PATH_INFO: `/v3/services` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:24.213291 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78885c3-a95e-4030-8972-2ca0aa3db9d8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:38:24.213603 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78885c3-a95e-4030-8972-2ca0aa3db9d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:24.215061 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78885c3-a95e-4030-8972-2ca0aa3db9d8 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:24.220984 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 402/800] 10.222.0.16 () {56 vars in 1112 bytes} [Fri Jul 15 20:38:24 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:38:26.455615 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc54c0-1935-4f02-bb15-1e97e0ab63a7 None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:26.456142 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc54c0-1935-4f02-bb15-1e97e0ab63a7 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:26.456229 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc54c0-1935-4f02-bb15-1e97e0ab63a7 None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:26.457549 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 399/801] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:38:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:38:26.462931 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4df27-ab5a-4b1b-8431-bed95222a6a3 None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:26.463361 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4df27-ab5a-4b1b-8431-bed95222a6a3 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:26.463501 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4df27-ab5a-4b1b-8431-bed95222a6a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:26.481285 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-e1f4df27-ab5a-4b1b-8431-bed95222a6a3 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:26.482497 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-e1f4df27-ab5a-4b1b-8431-bed95222a6a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:26.494218 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bfed5d-c8b1-43b8-9c55-2119f3a036e6 None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:26.494512 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bfed5d-c8b1-43b8-9c55-2119f3a036e6 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:26.494795 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bfed5d-c8b1-43b8-9c55-2119f3a036e6 None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:26.496158 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 400/802] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:38:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 20:38:26.501557 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c23ca-a021-41e2-9f69-60eeb7e5a4f0 None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:26.501854 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c23ca-a021-41e2-9f69-60eeb7e5a4f0 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:26.502176 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c23ca-a021-41e2-9f69-60eeb7e5a4f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:26.519491 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-0e9c23ca-a021-41e2-9f69-60eeb7e5a4f0 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:26.521007 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-0e9c23ca-a021-41e2-9f69-60eeb7e5a4f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:26.536011 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:26.550953 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 403/803] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:38:26 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 20:38:26.574905 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f4df27-ab5a-4b1b-8431-bed95222a6a3 None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:26.588775 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 401/804] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:38:26 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 20:38:26.614991 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c23ca-a021-41e2-9f69-60eeb7e5a4f0 None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:26.674354 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f4df27-ab5a-4b1b-8431-bed95222a6a3 None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:26.707066 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419079b6-a679-422d-aec4-868ac3f576f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:26.707652 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419079b6-a679-422d-aec4-868ac3f576f4 None admin] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:26.707933 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419079b6-a679-422d-aec4-868ac3f576f4 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:26.708213 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419079b6-a679-422d-aec4-868ac3f576f4 None admin] PATH_INFO: `/v3/services` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:26.708915 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419079b6-a679-422d-aec4-868ac3f576f4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:26.710300 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419079b6-a679-422d-aec4-868ac3f576f4 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:26.712096 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c23ca-a021-41e2-9f69-60eeb7e5a4f0 None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:26.723732 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 404/805] 10.222.0.16 () {60 vars in 1141 bytes} [Fri Jul 15 20:38:26 2022] POST /identity/v3/services => generated 242 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 20:38:26.726747 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:26.755732 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986fff26-9ec1-4aba-80b3-d9bf337e905a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:26.756417 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986fff26-9ec1-4aba-80b3-d9bf337e905a None admin] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:26.756706 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986fff26-9ec1-4aba-80b3-d9bf337e905a None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:26.756988 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986fff26-9ec1-4aba-80b3-d9bf337e905a None admin] PATH_INFO: `/v3/users` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:26.757693 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986fff26-9ec1-4aba-80b3-d9bf337e905a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:26.759192 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986fff26-9ec1-4aba-80b3-d9bf337e905a None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:26.774615 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.sql.core [None req-986fff26-9ec1-4aba-80b3-d9bf337e905a None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 15 20:38:26.774615 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 15 20:38:26.774615 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [parameters: {'user_id': '2030b593ffef4f8fb38a52cadbc2cc72', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 15 20:38:26.774615 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=98951) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 15 20:38:26.782684 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-986fff26-9ec1-4aba-80b3-d9bf337e905a None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 15 20:38:26.782684 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:38:26.782684 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 15 20:38:26.782684 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 15 20:38:26.782684 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 15 20:38:26.782684 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 15 20:38:26.782684 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 15 20:38:26.782684 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application result = self._query(query) Jul 15 20:38:26.782684 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 15 20:38:26.782684 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application conn.query(q) Jul 15 20:38:26.782684 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 15 20:38:26.782684 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 15 20:38:26.782684 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 15 20:38:26.782684 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application result.read() Jul 15 20:38:26.782684 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 15 20:38:26.783742 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 15 20:38:26.783742 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 15 20:38:26.783742 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 15 20:38:26.783742 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 15 20:38:26.783742 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 15 20:38:26.783742 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 15 20:38:26.783742 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 15 20:38:26.783742 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 15 20:38:26.783742 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:38:26.783742 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 15 20:38:26.783742 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:38:26.783742 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:38:26.783742 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 15 20:38:26.783742 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 15 20:38:26.783742 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 15 20:38:26.783742 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 15 20:38:26.783742 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 15 20:38:26.783742 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application next(self.gen) Jul 15 20:38:26.784863 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 15 20:38:26.784863 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application yield resource Jul 15 20:38:26.784863 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 15 20:38:26.784863 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application next(self.gen) Jul 15 20:38:26.784863 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 15 20:38:26.784863 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application self.session.rollback() Jul 15 20:38:26.784863 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 15 20:38:26.784863 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application self.force_reraise() Jul 15 20:38:26.784863 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 15 20:38:26.784863 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise self.value Jul 15 20:38:26.784863 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 15 20:38:26.784863 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 15 20:38:26.784863 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 15 20:38:26.784863 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application session.commit() Jul 15 20:38:26.784863 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 15 20:38:26.784863 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 15 20:38:26.784863 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 15 20:38:26.785854 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application self._prepare_impl() Jul 15 20:38:26.785854 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 15 20:38:26.785854 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application self.session.flush() Jul 15 20:38:26.785854 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 15 20:38:26.785854 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application self._flush(objects) Jul 15 20:38:26.785854 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 15 20:38:26.785854 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 15 20:38:26.785854 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 15 20:38:26.785854 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application compat.raise_( Jul 15 20:38:26.785854 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 15 20:38:26.785854 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception Jul 15 20:38:26.785854 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 15 20:38:26.785854 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application flush_context.execute() Jul 15 20:38:26.785854 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 15 20:38:26.785854 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rec.execute(self) Jul 15 20:38:26.785854 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 15 20:38:26.785854 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 15 20:38:26.787437 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 15 20:38:26.787437 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 15 20:38:26.787437 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 15 20:38:26.787437 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 15 20:38:26.787437 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 15 20:38:26.787437 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 15 20:38:26.787437 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 15 20:38:26.787437 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 15 20:38:26.787437 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 15 20:38:26.787437 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 15 20:38:26.787437 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 15 20:38:26.787437 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 15 20:38:26.787437 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 15 20:38:26.787437 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 15 20:38:26.787437 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 15 20:38:26.787437 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception Jul 15 20:38:26.788450 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 15 20:38:26.788450 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 15 20:38:26.788450 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 15 20:38:26.788450 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 15 20:38:26.788450 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 15 20:38:26.788450 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application result = self._query(query) Jul 15 20:38:26.788450 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 15 20:38:26.788450 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application conn.query(q) Jul 15 20:38:26.788450 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 15 20:38:26.788450 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 15 20:38:26.788450 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 15 20:38:26.788450 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application result.read() Jul 15 20:38:26.788450 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 15 20:38:26.788450 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 15 20:38:26.788450 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 15 20:38:26.788450 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 15 20:38:26.789512 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 15 20:38:26.789512 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 15 20:38:26.789512 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 15 20:38:26.789512 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 15 20:38:26.789512 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 15 20:38:26.789512 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 15 20:38:26.789512 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [parameters: {'user_id': '2030b593ffef4f8fb38a52cadbc2cc72', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 15 20:38:26.789512 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 15 20:38:26.789512 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:38:26.789512 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 20:38:26.789512 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:38:26.789512 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:38:26.789512 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:38:26.789512 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:38:26.789512 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:38:26.790369 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:38:26.790369 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:38:26.790369 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:38:26.790369 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:38:26.790369 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:38:26.790369 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:38:26.790369 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:38:26.790369 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 15 20:38:26.790369 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 15 20:38:26.790369 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:38:26.790369 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:38:26.790369 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 20:38:26.790369 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:38:26.790369 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 20:38:26.790369 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:38:26.790369 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 15 20:38:26.790369 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 15 20:38:26.791493 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 15 20:38:26.791493 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 15 20:38:26.791493 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 15 20:38:26.791493 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 15 20:38:26.791493 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 15 20:38:26.791493 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:38:26.791493 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 402/806] 10.222.0.16 () {60 vars in 1131 bytes} [Fri Jul 15 20:38:26 2022] POST /identity/v3/users => generated 160 bytes in 169 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 15 20:38:26.791964 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419079b6-a679-422d-aec4-868ac3f576f4 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:26.844971 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:26.905722 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419079b6-a679-422d-aec4-868ac3f576f4 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:26.942875 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f9ba36-e2ed-4c5c-908a-575de5552b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:26.943674 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f9ba36-e2ed-4c5c-908a-575de5552b6e None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:26.943961 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f9ba36-e2ed-4c5c-908a-575de5552b6e None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:26.944236 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f9ba36-e2ed-4c5c-908a-575de5552b6e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:26.952552 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f9ba36-e2ed-4c5c-908a-575de5552b6e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:26.954013 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f9ba36-e2ed-4c5c-908a-575de5552b6e None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:26.968480 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-86f9ba36-e2ed-4c5c-908a-575de5552b6e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 15 20:38:26.968480 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:38:26.968480 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:38:26.968480 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:38:26.968480 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:38:26.968480 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:38:26.968480 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:38:26.968480 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:38:26.968480 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:38:26.968480 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:38:26.968480 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:38:26.968480 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:38:26.968480 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 20:38:26.968480 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 20:38:26.968480 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 20:38:26.968480 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 20:38:26.969600 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:38:26.969600 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:38:26.969600 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 20:38:26.969600 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:38:26.969600 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 20:38:26.969600 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:38:26.969600 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:38:26.969600 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:38:26.969600 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:38:26.969600 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:38:26.969600 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:38:26.969600 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:38:26.969600 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:38:26.969600 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:38:26.969600 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:38:26.969600 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:38:26.969600 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:38:26.969600 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:38:26.970559 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:38:26.970559 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:38:26.970559 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 20:38:26.970559 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 20:38:26.970559 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 20:38:26.970559 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 20:38:26.970559 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 20:38:26.970559 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 20:38:26.970559 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 15 20:38:26.970559 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:38:26.970559 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 405/807] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jul 15 20:38:26 2022] GET /identity/v3/users/cinder => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:38:26.975880 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986fff26-9ec1-4aba-80b3-d9bf337e905a None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:27.078549 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986fff26-9ec1-4aba-80b3-d9bf337e905a None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:27.112555 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34624699-8fcd-49a0-bd73-10c9843b5664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:27.113228 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34624699-8fcd-49a0-bd73-10c9843b5664 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:27.113546 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34624699-8fcd-49a0-bd73-10c9843b5664 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:27.113828 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34624699-8fcd-49a0-bd73-10c9843b5664 None admin] PATH_INFO: `/v3/users` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:27.114661 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34624699-8fcd-49a0-bd73-10c9843b5664 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:38:27.114971 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34624699-8fcd-49a0-bd73-10c9843b5664 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:27.116594 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34624699-8fcd-49a0-bd73-10c9843b5664 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:27.153473 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 403/808] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Jul 15 20:38:26 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:38:28.959891 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4625222d-e16b-4c76-9bae-80c333f0b2ea None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:28.960417 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4625222d-e16b-4c76-9bae-80c333f0b2ea None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:28.960512 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4625222d-e16b-4c76-9bae-80c333f0b2ea None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:28.961790 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 406/809] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:38:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:38:28.967173 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ee1e0-fe33-482f-9125-c39f12529e8b None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:28.967563 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ee1e0-fe33-482f-9125-c39f12529e8b None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:28.967744 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ee1e0-fe33-482f-9125-c39f12529e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:28.985571 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-507ee1e0-fe33-482f-9125-c39f12529e8b None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:28.987194 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-507ee1e0-fe33-482f-9125-c39f12529e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:29.010451 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:29.053770 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 404/810] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:38:28 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 20:38:29.082993 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4625222d-e16b-4c76-9bae-80c333f0b2ea None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:29.181164 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4625222d-e16b-4c76-9bae-80c333f0b2ea None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:29.190183 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:29.214398 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25e374d-b812-42e4-83ba-edb58a58bd09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:29.215116 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e374d-b812-42e4-83ba-edb58a58bd09 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:29.215402 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e374d-b812-42e4-83ba-edb58a58bd09 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:29.215678 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e374d-b812-42e4-83ba-edb58a58bd09 None admin] PATH_INFO: `/v3/services/compute` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:29.216355 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25e374d-b812-42e4-83ba-edb58a58bd09 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:29.217716 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25e374d-b812-42e4-83ba-edb58a58bd09 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:29.229136 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-c25e374d-b812-42e4-83ba-edb58a58bd09 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 15 20:38:29.229136 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:38:29.229136 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 20:38:29.229136 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 20:38:29.229136 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 20:38:29.229136 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 20:38:29.229136 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 20:38:29.229136 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:38:29.229136 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 15 20:38:29.229136 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:38:29.229136 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 20:38:29.229136 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:38:29.229136 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:38:29.229136 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:38:29.229136 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:38:29.229136 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:38:29.229136 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:38:29.230274 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:38:29.230274 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:38:29.230274 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:38:29.230274 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:38:29.230274 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:38:29.230274 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:38:29.230274 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 20:38:29.230274 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 20:38:29.230274 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 20:38:29.230274 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 20:38:29.230274 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:38:29.230274 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:38:29.230274 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:38:29.230274 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:38:29.230274 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:38:29.230274 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:38:29.231294 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:38:29.231294 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:38:29.231294 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:38:29.231294 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:38:29.231294 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:38:29.231294 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:38:29.231294 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:38:29.231294 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:38:29.231294 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:38:29.231294 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:38:29.231294 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 20:38:29.231294 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:38:29.231294 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 15 20:38:29.231294 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:38:29.231294 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 407/811] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jul 15 20:38:29 2022] GET /identity/v3/services/compute => generated 88 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:38:29.236932 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507ee1e0-fe33-482f-9125-c39f12529e8b None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:29.333214 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507ee1e0-fe33-482f-9125-c39f12529e8b None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:29.365946 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8c89f5-df5b-4ed2-a1e9-78dba1279a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:29.366618 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8c89f5-df5b-4ed2-a1e9-78dba1279a82 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:29.366910 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8c89f5-df5b-4ed2-a1e9-78dba1279a82 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:29.367192 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8c89f5-df5b-4ed2-a1e9-78dba1279a82 None admin] PATH_INFO: `/v3/services` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:29.367890 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8c89f5-df5b-4ed2-a1e9-78dba1279a82 None admin] RBAC: Adding query filter params (name=compute) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:38:29.368201 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8c89f5-df5b-4ed2-a1e9-78dba1279a82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:29.369558 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8c89f5-df5b-4ed2-a1e9-78dba1279a82 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:29.374896 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 405/812] 10.222.0.16 () {56 vars in 1112 bytes} [Fri Jul 15 20:38:29 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:38:29.380585 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25e374d-b812-42e4-83ba-edb58a58bd09 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:29.477594 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25e374d-b812-42e4-83ba-edb58a58bd09 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:29.510529 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2976d4b-5e82-4966-8909-0324571cbaa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:29.511177 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2976d4b-5e82-4966-8909-0324571cbaa7 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:29.511465 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2976d4b-5e82-4966-8909-0324571cbaa7 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:29.511745 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2976d4b-5e82-4966-8909-0324571cbaa7 None admin] PATH_INFO: `/v3/services` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:29.512443 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2976d4b-5e82-4966-8909-0324571cbaa7 None admin] RBAC: Adding query filter params (type=compute) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:38:29.512748 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2976d4b-5e82-4966-8909-0324571cbaa7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:29.514136 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2976d4b-5e82-4966-8909-0324571cbaa7 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:29.518760 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 408/813] 10.222.0.16 () {56 vars in 1112 bytes} [Fri Jul 15 20:38:29 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:38:29.524751 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8c89f5-df5b-4ed2-a1e9-78dba1279a82 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:29.550477 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:29.622472 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8c89f5-df5b-4ed2-a1e9-78dba1279a82 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:29.654884 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8b2ed2-c944-49d4-988b-e72ea96680d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:29.655522 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b2ed2-c944-49d4-988b-e72ea96680d1 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:29.655809 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b2ed2-c944-49d4-988b-e72ea96680d1 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:29.656083 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b2ed2-c944-49d4-988b-e72ea96680d1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:29.656857 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8b2ed2-c944-49d4-988b-e72ea96680d1 None admin] RBAC: Adding query filter params (interface=public, service_id=55a651f813954a31bcba747ea548584d, region_id=RegionOne) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:38:29.657166 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8b2ed2-c944-49d4-988b-e72ea96680d1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:29.658598 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8b2ed2-c944-49d4-988b-e72ea96680d1 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:29.663708 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 406/814] 10.222.0.16 () {56 vars in 1251 bytes} [Fri Jul 15 20:38:29 2022] GET /identity/v3/endpoints?service_id=55a651f813954a31bcba747ea548584d&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:38:29.669202 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2976d4b-5e82-4966-8909-0324571cbaa7 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:29.703670 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:29.764459 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2976d4b-5e82-4966-8909-0324571cbaa7 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:29.796509 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bde52df-8efb-46bc-bf38-d2c18ce402fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:29.797151 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde52df-8efb-46bc-bf38-d2c18ce402fc None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:29.797436 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde52df-8efb-46bc-bf38-d2c18ce402fc None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:29.797713 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde52df-8efb-46bc-bf38-d2c18ce402fc None admin] PATH_INFO: `/v3/services` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:29.798411 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bde52df-8efb-46bc-bf38-d2c18ce402fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:29.799757 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bde52df-8efb-46bc-bf38-d2c18ce402fc None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:29.805647 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 409/815] 10.222.0.16 () {56 vars in 1087 bytes} [Fri Jul 15 20:38:29 2022] GET /identity/v3/services => generated 1728 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:38:32.017807 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c6166-3211-4f11-a499-97d89e0ae2f5 None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:32.018361 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c6166-3211-4f11-a499-97d89e0ae2f5 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:32.018472 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c6166-3211-4f11-a499-97d89e0ae2f5 None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:32.019758 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 407/816] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:38:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:38:32.024957 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f90712-0d1a-4ca5-bd24-c7d04a08d794 None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:32.025385 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f90712-0d1a-4ca5-bd24-c7d04a08d794 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:32.025527 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f90712-0d1a-4ca5-bd24-c7d04a08d794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:32.042360 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-a3f90712-0d1a-4ca5-bd24-c7d04a08d794 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:32.043549 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-a3f90712-0d1a-4ca5-bd24-c7d04a08d794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:32.113949 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 410/817] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:38:32 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 20:38:32.137457 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11c6166-3211-4f11-a499-97d89e0ae2f5 None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:32.224395 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:32.237079 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11c6166-3211-4f11-a499-97d89e0ae2f5 None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:32.269628 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d584b5-a94d-4ff7-b14d-59f40b92ac57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:32.270370 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d584b5-a94d-4ff7-b14d-59f40b92ac57 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:32.270659 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d584b5-a94d-4ff7-b14d-59f40b92ac57 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:32.270939 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d584b5-a94d-4ff7-b14d-59f40b92ac57 None admin] PATH_INFO: `/v3/services/compute` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:32.271577 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d584b5-a94d-4ff7-b14d-59f40b92ac57 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:32.272930 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d584b5-a94d-4ff7-b14d-59f40b92ac57 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:32.285137 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-45d584b5-a94d-4ff7-b14d-59f40b92ac57 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 15 20:38:32.285137 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:38:32.285137 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 20:38:32.285137 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 20:38:32.285137 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 20:38:32.285137 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 20:38:32.285137 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 20:38:32.285137 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:38:32.285137 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 15 20:38:32.285137 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:38:32.285137 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 20:38:32.285137 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:38:32.285137 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:38:32.285137 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:38:32.285137 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:38:32.285137 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:38:32.285137 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:38:32.286307 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:38:32.286307 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:38:32.286307 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:38:32.286307 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:38:32.286307 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:38:32.286307 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:38:32.286307 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 20:38:32.286307 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 20:38:32.286307 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 20:38:32.286307 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 20:38:32.286307 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:38:32.286307 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:38:32.286307 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:38:32.286307 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:38:32.286307 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:38:32.286307 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:38:32.287159 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:38:32.287159 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:38:32.287159 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:38:32.287159 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:38:32.287159 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:38:32.287159 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:38:32.287159 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:38:32.287159 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:38:32.287159 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:38:32.287159 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:38:32.287159 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 20:38:32.287159 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:38:32.287159 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 15 20:38:32.287159 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:38:32.287159 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 408/818] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jul 15 20:38:32 2022] GET /identity/v3/services/compute => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:38:32.292279 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f90712-0d1a-4ca5-bd24-c7d04a08d794 None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:32.320485 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:32.387867 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f90712-0d1a-4ca5-bd24-c7d04a08d794 None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:32.421796 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c224b2-2cb2-47ca-8fb9-c3c602d8a392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:32.422477 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c224b2-2cb2-47ca-8fb9-c3c602d8a392 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:32.422766 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c224b2-2cb2-47ca-8fb9-c3c602d8a392 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:32.423043 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c224b2-2cb2-47ca-8fb9-c3c602d8a392 None admin] PATH_INFO: `/v3/services` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:32.423741 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c224b2-2cb2-47ca-8fb9-c3c602d8a392 None admin] RBAC: Adding query filter params (name=compute) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:38:32.424049 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c224b2-2cb2-47ca-8fb9-c3c602d8a392 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:32.425405 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c224b2-2cb2-47ca-8fb9-c3c602d8a392 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:32.429966 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 411/819] 10.222.0.16 () {56 vars in 1112 bytes} [Fri Jul 15 20:38:32 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:38:32.435982 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d584b5-a94d-4ff7-b14d-59f40b92ac57 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:32.536062 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d584b5-a94d-4ff7-b14d-59f40b92ac57 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:32.569002 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d98d4d-a808-4a88-bec6-29e82c441833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:32.569904 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d98d4d-a808-4a88-bec6-29e82c441833 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:32.570222 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d98d4d-a808-4a88-bec6-29e82c441833 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:32.570498 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d98d4d-a808-4a88-bec6-29e82c441833 None admin] PATH_INFO: `/v3/services` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:32.571188 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d98d4d-a808-4a88-bec6-29e82c441833 None admin] RBAC: Adding query filter params (type=compute) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:38:32.571492 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d98d4d-a808-4a88-bec6-29e82c441833 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:32.572837 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d98d4d-a808-4a88-bec6-29e82c441833 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:32.577501 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 409/820] 10.222.0.16 () {56 vars in 1112 bytes} [Fri Jul 15 20:38:32 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:38:32.583295 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c224b2-2cb2-47ca-8fb9-c3c602d8a392 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:32.673558 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:32.680745 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c224b2-2cb2-47ca-8fb9-c3c602d8a392 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:32.713373 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e96d5b-fb5f-4a07-b603-a53aff97b6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:32.714024 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e96d5b-fb5f-4a07-b603-a53aff97b6cf None admin] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:32.714339 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e96d5b-fb5f-4a07-b603-a53aff97b6cf None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:32.714617 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e96d5b-fb5f-4a07-b603-a53aff97b6cf None admin] PATH_INFO: `/v3/endpoints` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:32.715339 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e96d5b-fb5f-4a07-b603-a53aff97b6cf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:32.717218 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e96d5b-fb5f-4a07-b603-a53aff97b6cf None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:32.734684 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 412/821] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Jul 15 20:38:32 2022] POST /identity/v3/endpoints => generated 334 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:38:42.575099 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=92 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:42.730053 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=24,keystone:INSERT=1 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:39:33.508000 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf34df-7d7a-4f72-8de1-63e9960e07f4 None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:33.508925 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf34df-7d7a-4f72-8de1-63e9960e07f4 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:33.508925 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf34df-7d7a-4f72-8de1-63e9960e07f4 None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:33.510190 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 410/822] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:39:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 20:39:33.516655 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26269faf-30fb-493e-b1e8-4153adc2f665 None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:33.517192 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26269faf-30fb-493e-b1e8-4153adc2f665 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:33.517278 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26269faf-30fb-493e-b1e8-4153adc2f665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:33.537865 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-26269faf-30fb-493e-b1e8-4153adc2f665 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:39:33.539426 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-26269faf-30fb-493e-b1e8-4153adc2f665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:39:33.628041 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 413/823] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:39:33 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 20:39:33.659000 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bf34df-7d7a-4f72-8de1-63e9960e07f4 None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:33.787738 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bf34df-7d7a-4f72-8de1-63e9960e07f4 None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:33.836245 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5076f65b-5dec-4426-a184-ea941a4ff7b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:33.837184 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5076f65b-5dec-4426-a184-ea941a4ff7b8 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:33.837627 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5076f65b-5dec-4426-a184-ea941a4ff7b8 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:33.837952 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5076f65b-5dec-4426-a184-ea941a4ff7b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:33.850937 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5076f65b-5dec-4426-a184-ea941a4ff7b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:33.852587 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5076f65b-5dec-4426-a184-ea941a4ff7b8 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:33.872976 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-5076f65b-5dec-4426-a184-ea941a4ff7b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:39:33.872976 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:39:33.872976 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:39:33.872976 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:39:33.872976 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:39:33.872976 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:39:33.872976 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:39:33.872976 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:39:33.872976 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:39:33.872976 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:39:33.872976 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:39:33.872976 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:39:33.872976 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:39:33.872976 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:39:33.872976 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:39:33.874198 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:39:33.874198 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:39:33.874198 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:39:33.874198 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:39:33.874198 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:39:33.874198 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:39:33.874198 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:39:33.874198 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:39:33.874198 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:39:33.874198 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:39:33.874198 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:39:33.874198 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:39:33.874198 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:39:33.874198 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:39:33.874198 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:39:33.874198 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:39:33.874198 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:39:33.880622 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:39:33.880622 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:39:33.880622 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:39:33.880622 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:39:33.880622 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 411/824] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jul 15 20:39:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:39:33.880953 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26269faf-30fb-493e-b1e8-4153adc2f665 None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:34.026715 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26269faf-30fb-493e-b1e8-4153adc2f665 None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:34.057791 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:39:34.068935 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af48497-17ad-435e-a5e2-323ea586ded8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:34.069590 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af48497-17ad-435e-a5e2-323ea586ded8 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:34.070891 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af48497-17ad-435e-a5e2-323ea586ded8 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:34.070891 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af48497-17ad-435e-a5e2-323ea586ded8 None admin] PATH_INFO: `/v3/domains` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:34.071189 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af48497-17ad-435e-a5e2-323ea586ded8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:39:34.071492 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af48497-17ad-435e-a5e2-323ea586ded8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:34.072836 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af48497-17ad-435e-a5e2-323ea586ded8 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:34.088526 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 414/825] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jul 15 20:39:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:39:34.095178 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5076f65b-5dec-4426-a184-ea941a4ff7b8 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:34.162858 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:39:34.219414 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5076f65b-5dec-4426-a184-ea941a4ff7b8 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:34.262264 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d08ee00-29f2-48cc-8adb-f0499d6785e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:34.263073 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d08ee00-29f2-48cc-8adb-f0499d6785e1 None admin] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:34.263358 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d08ee00-29f2-48cc-8adb-f0499d6785e1 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:34.263637 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d08ee00-29f2-48cc-8adb-f0499d6785e1 None admin] PATH_INFO: `/v3/users` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:34.264329 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d08ee00-29f2-48cc-8adb-f0499d6785e1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:34.265824 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d08ee00-29f2-48cc-8adb-f0499d6785e1 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:34.291866 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 412/826] 10.222.0.16 () {60 vars in 1132 bytes} [Fri Jul 15 20:39:34 2022] POST /identity/v3/users => generated 251 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:39:36.892550 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9cf6dc-5b35-488d-9e72-4d617e8f0ac4 None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:36.893099 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9cf6dc-5b35-488d-9e72-4d617e8f0ac4 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:36.893345 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9cf6dc-5b35-488d-9e72-4d617e8f0ac4 None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:36.894997 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 415/827] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:39:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:39:36.900603 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3300d6-3ef8-42a6-9576-c90d8cbf4db9 None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:36.901101 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3300d6-3ef8-42a6-9576-c90d8cbf4db9 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:36.901607 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3300d6-3ef8-42a6-9576-c90d8cbf4db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:36.926743 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-8b3300d6-3ef8-42a6-9576-c90d8cbf4db9 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:39:36.928341 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-8b3300d6-3ef8-42a6-9576-c90d8cbf4db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:39:37.000800 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 413/828] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:39:36 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 20:39:37.032304 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9cf6dc-5b35-488d-9e72-4d617e8f0ac4 None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:37.143937 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9cf6dc-5b35-488d-9e72-4d617e8f0ac4 None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:37.186039 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66613c7-130e-45fe-8c2b-6be5c00d6cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:37.186870 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66613c7-130e-45fe-8c2b-6be5c00d6cb7 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:37.187167 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66613c7-130e-45fe-8c2b-6be5c00d6cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:37.187451 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66613c7-130e-45fe-8c2b-6be5c00d6cb7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:37.200222 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66613c7-130e-45fe-8c2b-6be5c00d6cb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:39:37.209163 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-d66613c7-130e-45fe-8c2b-6be5c00d6cb7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 20:39:37.209163 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:39:37.209163 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:39:37.209163 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:39:37.209163 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:39:37.209163 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:39:37.209163 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:39:37.209163 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:39:37.209163 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:39:37.209163 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:39:37.209163 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:39:37.209163 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:39:37.209163 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:39:37.209163 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:39:37.209163 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:39:37.209163 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:39:37.210336 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:39:37.210336 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:39:37.210336 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:39:37.210336 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:39:37.210336 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:39:37.210336 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:39:37.210336 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:39:37.210336 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:39:37.210336 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:39:37.210336 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:39:37.210336 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:39:37.210336 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:39:37.210336 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:39:37.210336 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:39:37.210336 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:39:37.210336 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:39:37.211325 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:39:37.211325 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:39:37.211325 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:39:37.211325 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:39:37.211325 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:39:37.211325 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:39:37.211325 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:39:37.211325 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:39:37.211325 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:39:37.211325 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:39:37.211325 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 20:39:37.211325 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:39:37.211325 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 416/829] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Jul 15 20:39:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:39:37.218205 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3300d6-3ef8-42a6-9576-c90d8cbf4db9 None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:37.264504 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:39:37.329917 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3300d6-3ef8-42a6-9576-c90d8cbf4db9 None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:37.369683 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b942bf3-5c83-472a-8011-356446b96ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:37.370477 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b942bf3-5c83-472a-8011-356446b96ce1 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:37.371370 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b942bf3-5c83-472a-8011-356446b96ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:37.371539 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b942bf3-5c83-472a-8011-356446b96ce1 None admin] PATH_INFO: `/v3/roles` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:37.372305 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b942bf3-5c83-472a-8011-356446b96ce1 None admin] RBAC: Adding query filter params (name=service) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:39:37.372585 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b942bf3-5c83-472a-8011-356446b96ce1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:37.373977 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b942bf3-5c83-472a-8011-356446b96ce1 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:37.382243 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 414/830] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Jul 15 20:39:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:39:37.389026 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66613c7-130e-45fe-8c2b-6be5c00d6cb7 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:37.436665 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:39:37.501102 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66613c7-130e-45fe-8c2b-6be5c00d6cb7 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:37.537677 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d0b95f-d09d-4448-b0eb-79dd921e5565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:37.538505 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d0b95f-d09d-4448-b0eb-79dd921e5565 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:37.538795 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d0b95f-d09d-4448-b0eb-79dd921e5565 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:37.539101 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d0b95f-d09d-4448-b0eb-79dd921e5565 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:37.550317 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d0b95f-d09d-4448-b0eb-79dd921e5565 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:37.551768 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d0b95f-d09d-4448-b0eb-79dd921e5565 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:37.571610 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-e3d0b95f-d09d-4448-b0eb-79dd921e5565 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:39:37.571610 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:39:37.571610 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:39:37.571610 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:39:37.571610 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:39:37.571610 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:39:37.571610 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:39:37.571610 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:39:37.571610 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:39:37.571610 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:39:37.571610 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:39:37.571610 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:39:37.571610 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:39:37.571610 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:39:37.571610 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:39:37.572829 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:39:37.572829 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:39:37.572829 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:39:37.572829 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:39:37.572829 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:39:37.572829 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:39:37.572829 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:39:37.572829 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:39:37.572829 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:39:37.572829 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:39:37.572829 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:39:37.572829 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:39:37.572829 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:39:37.572829 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:39:37.572829 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:39:37.572829 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:39:37.572829 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:39:37.573881 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:39:37.573881 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:39:37.573881 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:39:37.573881 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:39:37.573881 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 417/831] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jul 15 20:39:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:39:37.580651 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b942bf3-5c83-472a-8011-356446b96ce1 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:37.683112 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:39:37.689456 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b942bf3-5c83-472a-8011-356446b96ce1 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:37.723727 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3607c816-caeb-45b4-8cff-1462c3921cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:37.724415 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3607c816-caeb-45b4-8cff-1462c3921cdb None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:37.724794 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3607c816-caeb-45b4-8cff-1462c3921cdb None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:37.724996 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3607c816-caeb-45b4-8cff-1462c3921cdb None admin] PATH_INFO: `/v3/domains` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:37.725696 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3607c816-caeb-45b4-8cff-1462c3921cdb None admin] RBAC: Adding query filter params (name=Default) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:39:37.726004 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3607c816-caeb-45b4-8cff-1462c3921cdb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:37.727397 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3607c816-caeb-45b4-8cff-1462c3921cdb None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:37.738974 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 415/832] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jul 15 20:39:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:39:37.744712 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d0b95f-d09d-4448-b0eb-79dd921e5565 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:37.853878 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:39:37.858236 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d0b95f-d09d-4448-b0eb-79dd921e5565 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:37.894680 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08828d33-0ab3-44ac-bdfa-2e8518e434f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:37.895484 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08828d33-0ab3-44ac-bdfa-2e8518e434f6 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:37.895774 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08828d33-0ab3-44ac-bdfa-2e8518e434f6 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:37.896069 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08828d33-0ab3-44ac-bdfa-2e8518e434f6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:37.903391 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08828d33-0ab3-44ac-bdfa-2e8518e434f6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:37.904846 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08828d33-0ab3-44ac-bdfa-2e8518e434f6 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:37.922217 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-08828d33-0ab3-44ac-bdfa-2e8518e434f6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 15 20:39:37.922217 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:39:37.922217 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:39:37.922217 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:39:37.922217 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:39:37.922217 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:39:37.922217 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:39:37.922217 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:39:37.922217 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:39:37.922217 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:39:37.922217 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:39:37.922217 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:39:37.922217 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 20:39:37.922217 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 20:39:37.922217 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 20:39:37.922217 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 20:39:37.923249 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:39:37.923249 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:39:37.923249 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 20:39:37.923249 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:39:37.923249 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 20:39:37.923249 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:39:37.923249 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:39:37.923249 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:39:37.923249 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:39:37.923249 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:39:37.923249 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:39:37.923249 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:39:37.923249 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:39:37.923249 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:39:37.923249 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:39:37.923249 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:39:37.923249 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:39:37.923249 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:39:37.924191 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:39:37.924191 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:39:37.924191 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 20:39:37.924191 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 20:39:37.924191 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 20:39:37.924191 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 20:39:37.924191 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 20:39:37.924191 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 20:39:37.924191 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 15 20:39:37.924191 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:39:37.924191 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 418/833] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jul 15 20:39:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:39:37.929551 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3607c816-caeb-45b4-8cff-1462c3921cdb None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:38.048975 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3607c816-caeb-45b4-8cff-1462c3921cdb None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:38.086341 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c80d1fd-0194-4463-9537-40fc6a95d9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:38.087013 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c80d1fd-0194-4463-9537-40fc6a95d9d0 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:38.087325 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c80d1fd-0194-4463-9537-40fc6a95d9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:38.087643 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c80d1fd-0194-4463-9537-40fc6a95d9d0 None admin] PATH_INFO: `/v3/users` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:38.088658 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c80d1fd-0194-4463-9537-40fc6a95d9d0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:39:38.089057 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c80d1fd-0194-4463-9537-40fc6a95d9d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:38.090646 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c80d1fd-0194-4463-9537-40fc6a95d9d0 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:38.109877 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 416/834] 10.222.0.16 () {56 vars in 1143 bytes} [Fri Jul 15 20:39:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:39:38.116264 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08828d33-0ab3-44ac-bdfa-2e8518e434f6 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:38.220504 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08828d33-0ab3-44ac-bdfa-2e8518e434f6 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:38.255421 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d29510e-d530-460d-bb61-a613a0ad1a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:38.256099 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d29510e-d530-460d-bb61-a613a0ad1a48 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:38.256360 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d29510e-d530-460d-bb61-a613a0ad1a48 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:38.256639 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d29510e-d530-460d-bb61-a613a0ad1a48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:38.285533 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:39:38.325911 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d29510e-d530-460d-bb61-a613a0ad1a48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:38.327325 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d29510e-d530-460d-bb61-a613a0ad1a48 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:38.438107 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 419/835] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jul 15 20:39:38 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 20:39:38.440107 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c80d1fd-0194-4463-9537-40fc6a95d9d0 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:38.465499 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:39:38.563684 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c80d1fd-0194-4463-9537-40fc6a95d9d0 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:38.600363 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923873a9-c141-4bd4-af5b-f33fc0d75477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:38.601303 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923873a9-c141-4bd4-af5b-f33fc0d75477 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:38.601506 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923873a9-c141-4bd4-af5b-f33fc0d75477 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:38.601816 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923873a9-c141-4bd4-af5b-f33fc0d75477 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:38.612414 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923873a9-c141-4bd4-af5b-f33fc0d75477 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:38.613860 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923873a9-c141-4bd4-af5b-f33fc0d75477 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:38.634814 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-923873a9-c141-4bd4-af5b-f33fc0d75477 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:39:38.634814 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:39:38.634814 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:39:38.634814 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:39:38.634814 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:39:38.634814 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:39:38.634814 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:39:38.634814 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:39:38.634814 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:39:38.634814 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:39:38.634814 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:39:38.634814 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:39:38.634814 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:39:38.634814 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:39:38.634814 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:39:38.635954 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:39:38.635954 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:39:38.635954 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:39:38.635954 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:39:38.635954 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:39:38.635954 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:39:38.635954 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:39:38.635954 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:39:38.635954 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:39:38.635954 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:39:38.635954 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:39:38.635954 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:39:38.635954 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:39:38.635954 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:39:38.635954 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:39:38.635954 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:39:38.635954 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:39:38.637536 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:39:38.637536 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:39:38.637536 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:39:38.637536 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:39:38.644450 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 417/836] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jul 15 20:39:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:39:38.644617 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d29510e-d530-460d-bb61-a613a0ad1a48 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:38.702447 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:39:38.750999 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d29510e-d530-460d-bb61-a613a0ad1a48 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:38.788660 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf85bd7-cf61-4e79-bb9f-baeb74e89e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:38.789333 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf85bd7-cf61-4e79-bb9f-baeb74e89e2b None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:38.789622 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf85bd7-cf61-4e79-bb9f-baeb74e89e2b None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:38.789904 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf85bd7-cf61-4e79-bb9f-baeb74e89e2b None admin] PATH_INFO: `/v3/domains` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:38.790653 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf85bd7-cf61-4e79-bb9f-baeb74e89e2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:39:38.790967 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf85bd7-cf61-4e79-bb9f-baeb74e89e2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:38.792347 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf85bd7-cf61-4e79-bb9f-baeb74e89e2b None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:38.804831 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 420/837] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jul 15 20:39:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:39:38.811453 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923873a9-c141-4bd4-af5b-f33fc0d75477 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:38.888839 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:39:38.920673 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923873a9-c141-4bd4-af5b-f33fc0d75477 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:38.956405 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e57a6c1-4d01-4834-abd0-a2b59b933ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:38.957210 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57a6c1-4d01-4834-abd0-a2b59b933ea3 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:38.957550 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57a6c1-4d01-4834-abd0-a2b59b933ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:38.957779 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57a6c1-4d01-4834-abd0-a2b59b933ea3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:38.965674 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e57a6c1-4d01-4834-abd0-a2b59b933ea3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:38.967131 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e57a6c1-4d01-4834-abd0-a2b59b933ea3 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:38.983400 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-6e57a6c1-4d01-4834-abd0-a2b59b933ea3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:39:38.983400 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:39:38.983400 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:39:38.983400 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:39:38.983400 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:39:38.983400 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:39:38.983400 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:39:38.983400 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:39:38.983400 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:39:38.983400 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:39:38.983400 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:39:38.983400 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:39:38.983400 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 20:39:38.983400 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 20:39:38.983400 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 20:39:38.984504 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 20:39:38.984504 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:39:38.984504 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:39:38.984504 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:39:38.984504 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:39:38.984504 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:39:38.984504 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:39:38.984504 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:39:38.984504 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:39:38.984504 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:39:38.984504 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:39:38.984504 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:39:38.984504 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:39:38.984504 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:39:38.984504 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:39:38.984504 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:39:38.984504 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:39:38.985551 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 20:39:38.985551 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 20:39:38.985551 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 20:39:38.985551 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 20:39:38.985551 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 20:39:38.985551 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 20:39:38.985551 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:39:38.985551 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:39:38.985551 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 418/838] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jul 15 20:39:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:39:38.991592 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf85bd7-cf61-4e79-bb9f-baeb74e89e2b None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:39.104178 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf85bd7-cf61-4e79-bb9f-baeb74e89e2b None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:39.124635 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:39:39.145069 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bcd52c-24e9-4525-8f77-f873917f3d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:39.145661 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bcd52c-24e9-4525-8f77-f873917f3d17 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:39.145952 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bcd52c-24e9-4525-8f77-f873917f3d17 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:39.146267 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bcd52c-24e9-4525-8f77-f873917f3d17 None admin] PATH_INFO: `/v3/projects` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:39.147060 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bcd52c-24e9-4525-8f77-f873917f3d17 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:39:39.147374 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bcd52c-24e9-4525-8f77-f873917f3d17 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:39.148844 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bcd52c-24e9-4525-8f77-f873917f3d17 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:39.161436 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 421/839] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jul 15 20:39:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:39:39.168548 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e57a6c1-4d01-4834-abd0-a2b59b933ea3 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:39.288358 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e57a6c1-4d01-4834-abd0-a2b59b933ea3 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:39.319011 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:39:39.328719 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a73dd7a-d110-4eba-a8a3-50ce735c6328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:39.329387 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73dd7a-d110-4eba-a8a3-50ce735c6328 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:39.329673 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73dd7a-d110-4eba-a8a3-50ce735c6328 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:39.329955 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73dd7a-d110-4eba-a8a3-50ce735c6328 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:39.330833 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a73dd7a-d110-4eba-a8a3-50ce735c6328 None admin] RBAC: Adding query filter params (role.id=5661c06533c14256aa58c232ba9db7cb, scope.project.id=0ea017caabac4346a1fc822ddfe3e8c2, user.id=913ad55c6c7b4c41ac22dd0a93ef656c) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:39:39.331189 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a73dd7a-d110-4eba-a8a3-50ce735c6328 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:39.332644 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a73dd7a-d110-4eba-a8a3-50ce735c6328 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:39.338424 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 419/840] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jul 15 20:39:39 2022] GET /identity/v3/role_assignments?user.id=913ad55c6c7b4c41ac22dd0a93ef656c&scope.project.id=0ea017caabac4346a1fc822ddfe3e8c2&role.id=5661c06533c14256aa58c232ba9db7cb => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:39:41.678140 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d514cc16-8cec-4432-8b84-97edbf71d865 None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:41.678946 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d514cc16-8cec-4432-8b84-97edbf71d865 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:41.678946 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d514cc16-8cec-4432-8b84-97edbf71d865 None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:41.680053 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 422/841] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:39:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:39:41.686334 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ec224-4832-4ebe-81d2-3c268fd415e8 None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:41.686774 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ec224-4832-4ebe-81d2-3c268fd415e8 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:41.687015 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ec224-4832-4ebe-81d2-3c268fd415e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:41.705545 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-d23ec224-4832-4ebe-81d2-3c268fd415e8 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:39:41.706847 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-d23ec224-4832-4ebe-81d2-3c268fd415e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:39:41.782236 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 420/842] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:39:41 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 20:39:41.806545 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d514cc16-8cec-4432-8b84-97edbf71d865 None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:41.913964 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d514cc16-8cec-4432-8b84-97edbf71d865 None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:41.951657 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705adc5d-210a-40a2-8ed3-0516367003bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:41.952476 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705adc5d-210a-40a2-8ed3-0516367003bf None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:41.952749 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705adc5d-210a-40a2-8ed3-0516367003bf None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:41.953027 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705adc5d-210a-40a2-8ed3-0516367003bf None admin] PATH_INFO: `/v3/roles/service` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:41.965517 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705adc5d-210a-40a2-8ed3-0516367003bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:39:41.974464 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-705adc5d-210a-40a2-8ed3-0516367003bf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 20:39:41.974464 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:39:41.974464 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:39:41.974464 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:39:41.974464 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:39:41.974464 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:39:41.974464 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:39:41.974464 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:39:41.974464 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:39:41.974464 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:39:41.974464 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:39:41.974464 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:39:41.974464 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:39:41.974464 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:39:41.974464 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:39:41.974464 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:39:41.975613 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:39:41.975613 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:39:41.975613 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:39:41.975613 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:39:41.975613 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:39:41.975613 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:39:41.975613 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:39:41.975613 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:39:41.975613 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:39:41.975613 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:39:41.975613 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:39:41.975613 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:39:41.975613 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:39:41.975613 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:39:41.975613 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:39:41.975613 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:39:41.976627 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:39:41.976627 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:39:41.976627 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:39:41.976627 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:39:41.976627 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:39:41.976627 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:39:41.976627 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:39:41.976627 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:39:41.976627 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:39:41.976627 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:39:41.976627 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 20:39:41.976627 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:39:41.982051 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 423/843] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Jul 15 20:39:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:39:41.983623 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23ec224-4832-4ebe-81d2-3c268fd415e8 None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:42.089295 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23ec224-4832-4ebe-81d2-3c268fd415e8 None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:42.114532 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:39:42.126556 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626c70e3-e1d0-4060-9489-5961bc11074f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:42.127329 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626c70e3-e1d0-4060-9489-5961bc11074f None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:42.127547 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626c70e3-e1d0-4060-9489-5961bc11074f None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:42.127832 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626c70e3-e1d0-4060-9489-5961bc11074f None admin] PATH_INFO: `/v3/roles` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:42.128680 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626c70e3-e1d0-4060-9489-5961bc11074f None admin] RBAC: Adding query filter params (name=service) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:39:42.129015 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626c70e3-e1d0-4060-9489-5961bc11074f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:42.130506 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626c70e3-e1d0-4060-9489-5961bc11074f None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:42.144014 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 421/844] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Jul 15 20:39:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:39:42.145142 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705adc5d-210a-40a2-8ed3-0516367003bf None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:42.191047 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:39:42.259939 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705adc5d-210a-40a2-8ed3-0516367003bf None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:42.298391 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3172931-7fab-4c73-bf1c-46840558f3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:42.299185 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3172931-7fab-4c73-bf1c-46840558f3dc None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:42.299471 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3172931-7fab-4c73-bf1c-46840558f3dc None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:42.299814 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3172931-7fab-4c73-bf1c-46840558f3dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:42.310487 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3172931-7fab-4c73-bf1c-46840558f3dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:42.312083 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3172931-7fab-4c73-bf1c-46840558f3dc None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:42.330102 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-b3172931-7fab-4c73-bf1c-46840558f3dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:39:42.330102 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:39:42.330102 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:39:42.330102 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:39:42.330102 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:39:42.330102 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:39:42.330102 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:39:42.330102 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:39:42.330102 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:39:42.330102 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:39:42.330102 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:39:42.330102 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:39:42.330102 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:39:42.330102 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:39:42.330102 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:39:42.331224 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:39:42.331224 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:39:42.331224 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:39:42.331224 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:39:42.331224 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:39:42.331224 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:39:42.331224 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:39:42.331224 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:39:42.331224 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:39:42.331224 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:39:42.331224 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:39:42.331224 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:39:42.331224 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:39:42.331224 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:39:42.331224 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:39:42.331224 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:39:42.331224 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:39:42.332339 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:39:42.332339 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:39:42.332339 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:39:42.332339 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:39:42.332903 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 424/845] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jul 15 20:39:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 20:39:42.338773 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626c70e3-e1d0-4060-9489-5961bc11074f None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:42.452420 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626c70e3-e1d0-4060-9489-5961bc11074f None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:42.491585 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105763d3-144b-4abd-a015-d707b23fba4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:42.492127 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105763d3-144b-4abd-a015-d707b23fba4a None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:42.492438 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105763d3-144b-4abd-a015-d707b23fba4a None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:42.492700 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105763d3-144b-4abd-a015-d707b23fba4a None admin] PATH_INFO: `/v3/domains` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:42.493430 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105763d3-144b-4abd-a015-d707b23fba4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:39:42.493744 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105763d3-144b-4abd-a015-d707b23fba4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:42.495188 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105763d3-144b-4abd-a015-d707b23fba4a None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:42.507501 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 422/846] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jul 15 20:39:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:39:42.513963 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3172931-7fab-4c73-bf1c-46840558f3dc None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:42.614099 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:39:42.624708 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3172931-7fab-4c73-bf1c-46840558f3dc None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:42.668909 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d713ebe7-1503-40d9-88eb-5e6b3854d623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:42.669715 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d713ebe7-1503-40d9-88eb-5e6b3854d623 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:42.670004 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d713ebe7-1503-40d9-88eb-5e6b3854d623 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:42.670331 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d713ebe7-1503-40d9-88eb-5e6b3854d623 None admin] PATH_INFO: `/v3/users/placement` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:42.678402 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d713ebe7-1503-40d9-88eb-5e6b3854d623 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:42.680002 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d713ebe7-1503-40d9-88eb-5e6b3854d623 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:42.695616 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-d713ebe7-1503-40d9-88eb-5e6b3854d623 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 15 20:39:42.695616 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:39:42.695616 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:39:42.695616 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:39:42.695616 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:39:42.695616 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:39:42.695616 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:39:42.695616 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:39:42.695616 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:39:42.695616 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:39:42.695616 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:39:42.695616 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:39:42.695616 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 20:39:42.695616 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 20:39:42.695616 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 20:39:42.695616 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 20:39:42.696606 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:39:42.696606 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:39:42.696606 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 20:39:42.696606 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:39:42.696606 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 20:39:42.696606 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:39:42.696606 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:39:42.696606 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:39:42.696606 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:39:42.696606 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:39:42.696606 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:39:42.696606 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:39:42.696606 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:39:42.696606 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:39:42.696606 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:39:42.696606 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:39:42.696606 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:39:42.696606 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:39:42.703185 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:39:42.703185 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:39:42.703185 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 20:39:42.703185 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 20:39:42.703185 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 20:39:42.703185 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 20:39:42.703185 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 20:39:42.703185 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 20:39:42.703185 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 15 20:39:42.703185 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:39:42.703185 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 425/847] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jul 15 20:39:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:39:42.704914 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105763d3-144b-4abd-a015-d707b23fba4a None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:42.754958 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:39:42.812961 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105763d3-144b-4abd-a015-d707b23fba4a None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:42.850447 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440eb3fd-64a8-4f3f-a568-2b1a6d74c1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:42.851120 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440eb3fd-64a8-4f3f-a568-2b1a6d74c1a8 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:42.851447 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440eb3fd-64a8-4f3f-a568-2b1a6d74c1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:42.851696 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440eb3fd-64a8-4f3f-a568-2b1a6d74c1a8 None admin] PATH_INFO: `/v3/users` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:42.852533 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440eb3fd-64a8-4f3f-a568-2b1a6d74c1a8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:39:42.852848 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440eb3fd-64a8-4f3f-a568-2b1a6d74c1a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:42.854316 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440eb3fd-64a8-4f3f-a568-2b1a6d74c1a8 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:42.873266 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 423/848] 10.222.0.16 () {56 vars in 1143 bytes} [Fri Jul 15 20:39:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:39:42.879016 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d713ebe7-1503-40d9-88eb-5e6b3854d623 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:42.984386 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d713ebe7-1503-40d9-88eb-5e6b3854d623 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:43.021992 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e2b4c5-d232-4cc3-9e77-e0781f14ba23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:43.022806 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e2b4c5-d232-4cc3-9e77-e0781f14ba23 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:43.023083 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e2b4c5-d232-4cc3-9e77-e0781f14ba23 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:43.023360 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e2b4c5-d232-4cc3-9e77-e0781f14ba23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:43.035232 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e2b4c5-d232-4cc3-9e77-e0781f14ba23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:43.036653 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e2b4c5-d232-4cc3-9e77-e0781f14ba23 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:43.056382 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-35e2b4c5-d232-4cc3-9e77-e0781f14ba23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:39:43.056382 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:39:43.056382 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:39:43.056382 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:39:43.056382 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:39:43.056382 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:39:43.056382 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:39:43.056382 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:39:43.056382 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:39:43.056382 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:39:43.056382 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:39:43.056382 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:39:43.056382 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:39:43.056382 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:39:43.056382 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:39:43.057542 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:39:43.057542 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:39:43.057542 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:39:43.057542 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:39:43.057542 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:39:43.057542 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:39:43.057542 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:39:43.057542 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:39:43.057542 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:39:43.057542 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:39:43.057542 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:39:43.057542 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:39:43.057542 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:39:43.057542 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:39:43.057542 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:39:43.057542 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:39:43.057542 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:39:43.059026 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:39:43.059026 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:39:43.059026 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:39:43.059026 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:39:43.059481 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 426/849] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jul 15 20:39:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:39:43.066052 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440eb3fd-64a8-4f3f-a568-2b1a6d74c1a8 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:43.191261 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440eb3fd-64a8-4f3f-a568-2b1a6d74c1a8 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:43.193790 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:39:43.227764 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee61295-462b-4d6f-b04d-c75bc3e0d5f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:43.228447 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee61295-462b-4d6f-b04d-c75bc3e0d5f8 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:43.228728 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee61295-462b-4d6f-b04d-c75bc3e0d5f8 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:43.229009 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee61295-462b-4d6f-b04d-c75bc3e0d5f8 None admin] PATH_INFO: `/v3/domains` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:43.229720 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee61295-462b-4d6f-b04d-c75bc3e0d5f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:39:43.230600 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee61295-462b-4d6f-b04d-c75bc3e0d5f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:43.231976 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee61295-462b-4d6f-b04d-c75bc3e0d5f8 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:43.243653 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 424/850] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jul 15 20:39:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:39:43.249822 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e2b4c5-d232-4cc3-9e77-e0781f14ba23 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:43.252758 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:39:43.381426 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e2b4c5-d232-4cc3-9e77-e0781f14ba23 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:43.416176 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1470f623-0380-48b2-916c-8f9efd4f9e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:43.417018 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1470f623-0380-48b2-916c-8f9efd4f9e15 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:43.417307 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1470f623-0380-48b2-916c-8f9efd4f9e15 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:43.418225 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1470f623-0380-48b2-916c-8f9efd4f9e15 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:43.424797 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1470f623-0380-48b2-916c-8f9efd4f9e15 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:43.426263 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1470f623-0380-48b2-916c-8f9efd4f9e15 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:43.440028 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-1470f623-0380-48b2-916c-8f9efd4f9e15 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:39:43.440028 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:39:43.440028 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:39:43.440028 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:39:43.440028 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:39:43.440028 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:39:43.440028 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:39:43.440028 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:39:43.440028 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:39:43.440028 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:39:43.440028 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:39:43.440028 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:39:43.440028 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 20:39:43.440028 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 20:39:43.440028 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 20:39:43.441003 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 20:39:43.441003 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:39:43.441003 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:39:43.441003 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:39:43.441003 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:39:43.441003 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:39:43.441003 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:39:43.441003 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:39:43.441003 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:39:43.441003 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:39:43.441003 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:39:43.441003 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:39:43.441003 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:39:43.441003 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:39:43.441003 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:39:43.441003 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:39:43.441003 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:39:43.447215 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 20:39:43.447215 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 20:39:43.447215 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 20:39:43.447215 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 20:39:43.447215 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 20:39:43.447215 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 20:39:43.447215 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:39:43.447215 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:39:43.447215 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 427/851] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jul 15 20:39:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:39:43.447706 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee61295-462b-4d6f-b04d-c75bc3e0d5f8 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:43.559951 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee61295-462b-4d6f-b04d-c75bc3e0d5f8 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:43.602340 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16f9480-5b8d-4448-bedd-b8e78901c794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:43.602928 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16f9480-5b8d-4448-bedd-b8e78901c794 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:43.603212 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16f9480-5b8d-4448-bedd-b8e78901c794 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:43.603514 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16f9480-5b8d-4448-bedd-b8e78901c794 None admin] PATH_INFO: `/v3/projects` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:43.604266 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16f9480-5b8d-4448-bedd-b8e78901c794 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:39:43.604577 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16f9480-5b8d-4448-bedd-b8e78901c794 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:43.606700 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16f9480-5b8d-4448-bedd-b8e78901c794 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:43.619398 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 425/852] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jul 15 20:39:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:39:43.625999 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1470f623-0380-48b2-916c-8f9efd4f9e15 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:43.693382 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:39:43.736462 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1470f623-0380-48b2-916c-8f9efd4f9e15 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:43.776581 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b98b61-96c6-4831-89fe-33fe65c5e96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:43.778021 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b98b61-96c6-4831-89fe-33fe65c5e96f None admin] REQUEST_METHOD: `PUT` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:43.778350 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b98b61-96c6-4831-89fe-33fe65c5e96f None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:43.778634 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b98b61-96c6-4831-89fe-33fe65c5e96f None admin] PATH_INFO: `/v3/projects/0ea017caabac4346a1fc822ddfe3e8c2/users/913ad55c6c7b4c41ac22dd0a93ef656c/roles/5661c06533c14256aa58c232ba9db7cb` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:43.793635 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b98b61-96c6-4831-89fe-33fe65c5e96f None admin] RBAC: Authorizing `identity:create_grant(project_id=0ea017caabac4346a1fc822ddfe3e8c2, user_id=913ad55c6c7b4c41ac22dd0a93ef656c, role_id=5661c06533c14256aa58c232ba9db7cb)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:43.795169 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b98b61-96c6-4831-89fe-33fe65c5e96f None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:43.807912 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 428/853] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Jul 15 20:39:43 2022] PUT /identity/v3/projects/0ea017caabac4346a1fc822ddfe3e8c2/users/913ad55c6c7b4c41ac22dd0a93ef656c/roles/5661c06533c14256aa58c232ba9db7cb => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:39:46.046382 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abebe4a-3a0b-43f3-b104-083aa816e9e7 None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:46.046962 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abebe4a-3a0b-43f3-b104-083aa816e9e7 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:46.046962 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abebe4a-3a0b-43f3-b104-083aa816e9e7 None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:46.048265 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 426/854] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:39:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:39:46.056692 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830af474-2348-4fa0-b249-5218265657d8 None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:46.057162 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830af474-2348-4fa0-b249-5218265657d8 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:46.057318 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830af474-2348-4fa0-b249-5218265657d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:46.076943 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-830af474-2348-4fa0-b249-5218265657d8 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:39:46.078553 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-830af474-2348-4fa0-b249-5218265657d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:39:46.152478 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 429/855] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:39:46 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 20:39:46.182531 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abebe4a-3a0b-43f3-b104-083aa816e9e7 None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:46.210188 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:39:46.294336 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abebe4a-3a0b-43f3-b104-083aa816e9e7 None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:46.330659 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73b6d30-4e16-4e5e-b1e1-9055d8b1e412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:46.331454 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b6d30-4e16-4e5e-b1e1-9055d8b1e412 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:46.331729 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b6d30-4e16-4e5e-b1e1-9055d8b1e412 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:46.332014 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b6d30-4e16-4e5e-b1e1-9055d8b1e412 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:46.344275 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73b6d30-4e16-4e5e-b1e1-9055d8b1e412 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:39:46.352291 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-a73b6d30-4e16-4e5e-b1e1-9055d8b1e412 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 20:39:46.352291 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:39:46.352291 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:39:46.352291 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:39:46.352291 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:39:46.352291 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:39:46.352291 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:39:46.352291 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:39:46.352291 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:39:46.352291 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:39:46.352291 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:39:46.352291 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:39:46.352291 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:39:46.352291 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:39:46.352291 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:39:46.352291 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:39:46.353473 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:39:46.353473 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:39:46.353473 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:39:46.353473 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:39:46.353473 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:39:46.353473 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:39:46.353473 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:39:46.353473 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:39:46.353473 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:39:46.353473 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:39:46.353473 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:39:46.353473 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:39:46.353473 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:39:46.353473 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:39:46.353473 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:39:46.353473 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:39:46.354501 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:39:46.354501 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:39:46.354501 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:39:46.354501 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:39:46.354501 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:39:46.354501 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:39:46.354501 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:39:46.354501 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:39:46.354501 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:39:46.354501 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:39:46.354501 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 20:39:46.354501 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:39:46.354501 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 427/856] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Jul 15 20:39:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:39:46.360565 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830af474-2348-4fa0-b249-5218265657d8 None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:46.406892 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:39:46.470585 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830af474-2348-4fa0-b249-5218265657d8 None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:46.507617 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689161cc-6e57-4f60-b820-22ee736fd5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:46.508271 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689161cc-6e57-4f60-b820-22ee736fd5d5 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:46.508563 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689161cc-6e57-4f60-b820-22ee736fd5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:46.508842 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689161cc-6e57-4f60-b820-22ee736fd5d5 None admin] PATH_INFO: `/v3/roles` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:46.509591 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689161cc-6e57-4f60-b820-22ee736fd5d5 None admin] RBAC: Adding query filter params (name=service) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:39:46.509905 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689161cc-6e57-4f60-b820-22ee736fd5d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:46.511354 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689161cc-6e57-4f60-b820-22ee736fd5d5 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:46.520576 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 430/857] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Jul 15 20:39:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:39:46.526298 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73b6d30-4e16-4e5e-b1e1-9055d8b1e412 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:46.618707 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:39:46.634639 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73b6d30-4e16-4e5e-b1e1-9055d8b1e412 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:46.671316 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bf7f3f-dbd4-4244-abfa-f313c20a5568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:46.672115 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf7f3f-dbd4-4244-abfa-f313c20a5568 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:46.672412 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf7f3f-dbd4-4244-abfa-f313c20a5568 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:46.672698 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf7f3f-dbd4-4244-abfa-f313c20a5568 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:46.685483 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bf7f3f-dbd4-4244-abfa-f313c20a5568 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:46.687354 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bf7f3f-dbd4-4244-abfa-f313c20a5568 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:46.706698 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-76bf7f3f-dbd4-4244-abfa-f313c20a5568 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:39:46.706698 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:39:46.706698 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:39:46.706698 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:39:46.706698 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:39:46.706698 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:39:46.706698 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:39:46.706698 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:39:46.706698 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:39:46.706698 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:39:46.706698 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:39:46.706698 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:39:46.706698 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:39:46.706698 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:39:46.706698 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:39:46.708016 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:39:46.708016 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:39:46.708016 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:39:46.708016 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:39:46.708016 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:39:46.708016 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:39:46.708016 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:39:46.708016 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:39:46.708016 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:39:46.708016 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:39:46.708016 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:39:46.708016 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:39:46.708016 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:39:46.708016 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:39:46.708016 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:39:46.708016 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:39:46.708016 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:39:46.708906 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:39:46.708906 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:39:46.708906 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:39:46.708906 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:39:46.708906 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 428/858] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jul 15 20:39:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:39:46.715574 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689161cc-6e57-4f60-b820-22ee736fd5d5 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:46.829957 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689161cc-6e57-4f60-b820-22ee736fd5d5 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:46.832518 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:39:46.871095 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fcf1c0-a002-4291-beb5-51d487e55779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:46.871891 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fcf1c0-a002-4291-beb5-51d487e55779 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:46.872274 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fcf1c0-a002-4291-beb5-51d487e55779 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:46.872586 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fcf1c0-a002-4291-beb5-51d487e55779 None admin] PATH_INFO: `/v3/domains` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:46.873444 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fcf1c0-a002-4291-beb5-51d487e55779 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:39:46.873863 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fcf1c0-a002-4291-beb5-51d487e55779 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:46.875405 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fcf1c0-a002-4291-beb5-51d487e55779 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:46.889469 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 431/859] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jul 15 20:39:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:39:46.895313 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bf7f3f-dbd4-4244-abfa-f313c20a5568 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:47.003565 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bf7f3f-dbd4-4244-abfa-f313c20a5568 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:47.046336 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5b0ff4-b3eb-4023-9e20-c1d48732b049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:47.047379 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b0ff4-b3eb-4023-9e20-c1d48732b049 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:47.047933 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b0ff4-b3eb-4023-9e20-c1d48732b049 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:47.048051 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b0ff4-b3eb-4023-9e20-c1d48732b049 None admin] PATH_INFO: `/v3/users/placement` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:47.051562 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:39:47.059658 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5b0ff4-b3eb-4023-9e20-c1d48732b049 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:47.063559 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5b0ff4-b3eb-4023-9e20-c1d48732b049 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:47.080173 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-be5b0ff4-b3eb-4023-9e20-c1d48732b049 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 15 20:39:47.080173 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:39:47.080173 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:39:47.080173 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:39:47.080173 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:39:47.080173 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:39:47.080173 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:39:47.080173 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:39:47.080173 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:39:47.080173 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:39:47.080173 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:39:47.080173 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:39:47.080173 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 20:39:47.080173 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 20:39:47.080173 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 20:39:47.080173 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 20:39:47.081206 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:39:47.081206 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:39:47.081206 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 20:39:47.081206 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:39:47.081206 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 20:39:47.081206 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:39:47.081206 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:39:47.081206 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:39:47.081206 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:39:47.081206 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:39:47.081206 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:39:47.081206 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:39:47.081206 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:39:47.081206 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:39:47.081206 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:39:47.081206 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:39:47.081206 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:39:47.081206 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:39:47.082479 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:39:47.082479 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:39:47.082479 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 20:39:47.082479 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 20:39:47.082479 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 20:39:47.082479 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 20:39:47.082479 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 20:39:47.082479 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 20:39:47.082479 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 15 20:39:47.082479 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:39:47.082479 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 429/860] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jul 15 20:39:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:39:47.087276 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fcf1c0-a002-4291-beb5-51d487e55779 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:47.210496 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fcf1c0-a002-4291-beb5-51d487e55779 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:47.247918 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea293f81-5212-46c9-a9e2-bf754c66621a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:47.248604 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea293f81-5212-46c9-a9e2-bf754c66621a None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:47.248976 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea293f81-5212-46c9-a9e2-bf754c66621a None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:47.249292 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea293f81-5212-46c9-a9e2-bf754c66621a None admin] PATH_INFO: `/v3/users` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:47.250320 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea293f81-5212-46c9-a9e2-bf754c66621a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:39:47.250784 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea293f81-5212-46c9-a9e2-bf754c66621a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:47.252259 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea293f81-5212-46c9-a9e2-bf754c66621a None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:47.276990 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 432/861] 10.222.0.16 () {56 vars in 1143 bytes} [Fri Jul 15 20:39:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:39:47.282948 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5b0ff4-b3eb-4023-9e20-c1d48732b049 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:47.394585 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5b0ff4-b3eb-4023-9e20-c1d48732b049 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:47.429728 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4dd152-1791-446f-9377-0ea638322f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:47.430470 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4dd152-1791-446f-9377-0ea638322f7f None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:47.430791 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4dd152-1791-446f-9377-0ea638322f7f None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:47.431081 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4dd152-1791-446f-9377-0ea638322f7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:47.504753 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:39:47.514642 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4dd152-1791-446f-9377-0ea638322f7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:47.516132 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4dd152-1791-446f-9377-0ea638322f7f None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:47.624786 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 430/862] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jul 15 20:39:47 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 15 20:39:47.631125 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea293f81-5212-46c9-a9e2-bf754c66621a None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:47.656461 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:39:47.737128 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea293f81-5212-46c9-a9e2-bf754c66621a None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:47.773561 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc4516e-fc2c-49ec-8689-4af37d4c4d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:47.774644 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc4516e-fc2c-49ec-8689-4af37d4c4d16 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:47.774817 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc4516e-fc2c-49ec-8689-4af37d4c4d16 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:47.775124 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc4516e-fc2c-49ec-8689-4af37d4c4d16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:47.786819 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc4516e-fc2c-49ec-8689-4af37d4c4d16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:47.788477 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc4516e-fc2c-49ec-8689-4af37d4c4d16 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:47.807646 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-6bc4516e-fc2c-49ec-8689-4af37d4c4d16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:39:47.807646 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:39:47.807646 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:39:47.807646 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:39:47.807646 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:39:47.807646 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:39:47.807646 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:39:47.807646 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:39:47.807646 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:39:47.807646 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:39:47.807646 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:39:47.807646 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:39:47.807646 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:39:47.807646 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:39:47.807646 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:39:47.809465 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:39:47.809465 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:39:47.809465 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:39:47.809465 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:39:47.809465 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:39:47.809465 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:39:47.809465 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:39:47.809465 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:39:47.809465 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:39:47.809465 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:39:47.809465 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:39:47.809465 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:39:47.809465 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:39:47.809465 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:39:47.809465 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:39:47.809465 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:39:47.809465 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:39:47.810596 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:39:47.810596 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:39:47.810596 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:39:47.810596 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:39:47.810596 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 433/863] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jul 15 20:39:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 20:39:47.815509 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4dd152-1791-446f-9377-0ea638322f7f None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:47.920251 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:39:47.926970 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4dd152-1791-446f-9377-0ea638322f7f None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:47.967270 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e81fa35-9fcf-4df9-9866-763982d6650e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:47.968053 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81fa35-9fcf-4df9-9866-763982d6650e None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:47.968346 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81fa35-9fcf-4df9-9866-763982d6650e None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:47.968694 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81fa35-9fcf-4df9-9866-763982d6650e None admin] PATH_INFO: `/v3/domains` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:47.969477 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e81fa35-9fcf-4df9-9866-763982d6650e None admin] RBAC: Adding query filter params (name=Default) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:39:47.969802 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e81fa35-9fcf-4df9-9866-763982d6650e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:47.971217 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e81fa35-9fcf-4df9-9866-763982d6650e None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:47.983538 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 431/864] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jul 15 20:39:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:39:47.989384 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc4516e-fc2c-49ec-8689-4af37d4c4d16 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:48.074028 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:39:48.100678 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc4516e-fc2c-49ec-8689-4af37d4c4d16 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:48.137901 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1cd2fa-391e-4325-9368-38e7b1f0272e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:48.138835 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1cd2fa-391e-4325-9368-38e7b1f0272e None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:48.139131 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1cd2fa-391e-4325-9368-38e7b1f0272e None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:48.139430 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1cd2fa-391e-4325-9368-38e7b1f0272e None admin] PATH_INFO: `/v3/projects/service` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:48.147237 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1cd2fa-391e-4325-9368-38e7b1f0272e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:48.148805 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1cd2fa-391e-4325-9368-38e7b1f0272e None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:48.165025 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-ec1cd2fa-391e-4325-9368-38e7b1f0272e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:39:48.165025 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:39:48.165025 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:39:48.165025 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:39:48.165025 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:39:48.165025 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:39:48.165025 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:39:48.165025 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:39:48.165025 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:39:48.165025 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:39:48.165025 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:39:48.165025 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:39:48.165025 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 20:39:48.165025 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 20:39:48.165025 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 20:39:48.166403 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 20:39:48.166403 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:39:48.166403 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:39:48.166403 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:39:48.166403 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:39:48.166403 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:39:48.166403 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:39:48.166403 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:39:48.166403 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:39:48.166403 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:39:48.166403 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:39:48.166403 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:39:48.166403 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:39:48.166403 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:39:48.166403 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:39:48.166403 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:39:48.166403 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:39:48.168086 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 20:39:48.168086 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 20:39:48.168086 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 20:39:48.168086 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 20:39:48.168086 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 20:39:48.168086 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 20:39:48.168086 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:39:48.168086 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:39:48.168086 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 434/865] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jul 15 20:39:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:39:48.173245 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e81fa35-9fcf-4df9-9866-763982d6650e None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:48.286383 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e81fa35-9fcf-4df9-9866-763982d6650e None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:48.322989 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db88629d-3146-434f-8d37-33dc825e60a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:48.323657 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88629d-3146-434f-8d37-33dc825e60a9 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:48.324467 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88629d-3146-434f-8d37-33dc825e60a9 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:48.324747 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88629d-3146-434f-8d37-33dc825e60a9 None admin] PATH_INFO: `/v3/projects` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:48.325528 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db88629d-3146-434f-8d37-33dc825e60a9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:39:48.325844 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db88629d-3146-434f-8d37-33dc825e60a9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:48.327316 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db88629d-3146-434f-8d37-33dc825e60a9 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:48.340419 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 432/866] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jul 15 20:39:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:39:48.346908 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1cd2fa-391e-4325-9368-38e7b1f0272e None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:48.454965 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1cd2fa-391e-4325-9368-38e7b1f0272e None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:48.492007 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d393b17-9184-4d9f-a7a2-094f02c32a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:48.492749 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d393b17-9184-4d9f-a7a2-094f02c32a8c None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:48.492981 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d393b17-9184-4d9f-a7a2-094f02c32a8c None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:48.493267 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d393b17-9184-4d9f-a7a2-094f02c32a8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:48.494225 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d393b17-9184-4d9f-a7a2-094f02c32a8c None admin] RBAC: Adding query filter params (role.id=5661c06533c14256aa58c232ba9db7cb, scope.project.id=0ea017caabac4346a1fc822ddfe3e8c2, user.id=913ad55c6c7b4c41ac22dd0a93ef656c) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:39:48.494546 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d393b17-9184-4d9f-a7a2-094f02c32a8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:48.496033 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d393b17-9184-4d9f-a7a2-094f02c32a8c None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:48.497964 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:39:48.518354 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 435/867] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jul 15 20:39:48 2022] GET /identity/v3/role_assignments?user.id=913ad55c6c7b4c41ac22dd0a93ef656c&scope.project.id=0ea017caabac4346a1fc822ddfe3e8c2&role.id=5661c06533c14256aa58c232ba9db7cb => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:39:50.832360 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54afccb7-a34d-4942-8e09-9f65daff2c5d None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:50.832892 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54afccb7-a34d-4942-8e09-9f65daff2c5d None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:50.832892 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54afccb7-a34d-4942-8e09-9f65daff2c5d None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:50.834244 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 433/868] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:39:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:39:50.840124 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19986cf-7d73-40a8-9636-302cfcbf4d89 None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:50.840560 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19986cf-7d73-40a8-9636-302cfcbf4d89 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:50.840680 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19986cf-7d73-40a8-9636-302cfcbf4d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:50.858953 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-a19986cf-7d73-40a8-9636-302cfcbf4d89 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:39:50.860240 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-a19986cf-7d73-40a8-9636-302cfcbf4d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:39:50.931504 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 436/869] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:39:50 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 20:39:50.956560 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54afccb7-a34d-4942-8e09-9f65daff2c5d None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:50.975478 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:39:51.076133 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54afccb7-a34d-4942-8e09-9f65daff2c5d None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:51.114406 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2317188f-b7a5-4aad-afe5-57215b89fc20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:51.115128 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2317188f-b7a5-4aad-afe5-57215b89fc20 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:51.115412 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2317188f-b7a5-4aad-afe5-57215b89fc20 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:51.115686 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2317188f-b7a5-4aad-afe5-57215b89fc20 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:51.127864 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2317188f-b7a5-4aad-afe5-57215b89fc20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:39:51.135980 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-2317188f-b7a5-4aad-afe5-57215b89fc20 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:39:51.135980 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:39:51.135980 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:39:51.135980 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:39:51.135980 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:39:51.135980 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:39:51.135980 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:39:51.135980 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:39:51.135980 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:39:51.135980 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:39:51.135980 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:39:51.135980 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:39:51.135980 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:39:51.135980 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:39:51.135980 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:39:51.135980 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:39:51.137121 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:39:51.137121 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:39:51.137121 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:39:51.137121 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:39:51.137121 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:39:51.137121 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:39:51.137121 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:39:51.137121 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:39:51.137121 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:39:51.137121 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:39:51.137121 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:39:51.137121 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:39:51.137121 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:39:51.137121 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:39:51.137121 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:39:51.137121 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:39:51.137964 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:39:51.137964 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:39:51.137964 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:39:51.137964 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:39:51.137964 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:39:51.137964 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:39:51.137964 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:39:51.137964 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:39:51.137964 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:39:51.137964 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:39:51.137964 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:39:51.137964 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:39:51.137964 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 434/870] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Jul 15 20:39:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:39:51.143707 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19986cf-7d73-40a8-9636-302cfcbf4d89 None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:51.263214 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19986cf-7d73-40a8-9636-302cfcbf4d89 None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:51.291392 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:39:51.300547 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a5ad0a-b9fd-457e-871c-a7d55ebc576e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:51.301417 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a5ad0a-b9fd-457e-871c-a7d55ebc576e None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:51.301725 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a5ad0a-b9fd-457e-871c-a7d55ebc576e None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:51.302005 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a5ad0a-b9fd-457e-871c-a7d55ebc576e None admin] PATH_INFO: `/v3/roles` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:51.302880 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a5ad0a-b9fd-457e-871c-a7d55ebc576e None admin] RBAC: Adding query filter params (name=admin) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:39:51.303234 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a5ad0a-b9fd-457e-871c-a7d55ebc576e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:51.304767 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a5ad0a-b9fd-457e-871c-a7d55ebc576e None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:51.313085 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 437/871] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jul 15 20:39:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:39:51.318863 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2317188f-b7a5-4aad-afe5-57215b89fc20 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:51.405517 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:39:51.429785 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2317188f-b7a5-4aad-afe5-57215b89fc20 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:51.468402 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbce06f8-0a0f-4656-b49e-0c0a4a66c9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:51.469196 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce06f8-0a0f-4656-b49e-0c0a4a66c9c0 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:51.469483 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce06f8-0a0f-4656-b49e-0c0a4a66c9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:51.469764 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce06f8-0a0f-4656-b49e-0c0a4a66c9c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:51.484519 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbce06f8-0a0f-4656-b49e-0c0a4a66c9c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:51.485996 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbce06f8-0a0f-4656-b49e-0c0a4a66c9c0 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:51.503131 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-cbce06f8-0a0f-4656-b49e-0c0a4a66c9c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:39:51.503131 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:39:51.503131 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:39:51.503131 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:39:51.503131 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:39:51.503131 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:39:51.503131 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:39:51.503131 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:39:51.503131 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:39:51.503131 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:39:51.503131 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:39:51.503131 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:39:51.503131 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:39:51.503131 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:39:51.503131 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:39:51.504108 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:39:51.504108 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:39:51.504108 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:39:51.504108 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:39:51.504108 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:39:51.504108 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:39:51.504108 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:39:51.504108 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:39:51.504108 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:39:51.504108 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:39:51.504108 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:39:51.504108 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:39:51.504108 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:39:51.504108 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:39:51.504108 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:39:51.504108 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:39:51.504108 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:39:51.505170 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:39:51.505170 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:39:51.505170 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:39:51.505170 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:39:51.505170 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 435/872] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jul 15 20:39:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:39:51.510626 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a5ad0a-b9fd-457e-871c-a7d55ebc576e None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:51.624910 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a5ad0a-b9fd-457e-871c-a7d55ebc576e None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:51.666016 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cb1549-2fe3-4868-9f2c-c93c5dd74bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:51.667326 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb1549-2fe3-4868-9f2c-c93c5dd74bd8 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:51.667982 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb1549-2fe3-4868-9f2c-c93c5dd74bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:51.668535 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb1549-2fe3-4868-9f2c-c93c5dd74bd8 None admin] PATH_INFO: `/v3/domains` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:51.669899 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cb1549-2fe3-4868-9f2c-c93c5dd74bd8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:39:51.670458 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cb1549-2fe3-4868-9f2c-c93c5dd74bd8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:51.672895 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cb1549-2fe3-4868-9f2c-c93c5dd74bd8 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:51.692700 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 438/873] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jul 15 20:39:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:39:51.700961 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbce06f8-0a0f-4656-b49e-0c0a4a66c9c0 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:51.814448 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbce06f8-0a0f-4656-b49e-0c0a4a66c9c0 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:51.842719 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:39:51.851060 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fe1e50-6a20-4bea-9ee6-e997fd239029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:51.851858 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe1e50-6a20-4bea-9ee6-e997fd239029 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:51.852146 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe1e50-6a20-4bea-9ee6-e997fd239029 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:51.852428 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe1e50-6a20-4bea-9ee6-e997fd239029 None admin] PATH_INFO: `/v3/users/placement` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:51.860682 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fe1e50-6a20-4bea-9ee6-e997fd239029 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:51.862364 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fe1e50-6a20-4bea-9ee6-e997fd239029 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:51.878511 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-33fe1e50-6a20-4bea-9ee6-e997fd239029 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 15 20:39:51.878511 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:39:51.878511 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:39:51.878511 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:39:51.878511 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:39:51.878511 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:39:51.878511 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:39:51.878511 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:39:51.878511 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:39:51.878511 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:39:51.878511 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:39:51.878511 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:39:51.878511 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 20:39:51.878511 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 20:39:51.878511 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 20:39:51.878511 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 20:39:51.879677 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:39:51.879677 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:39:51.879677 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 20:39:51.879677 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:39:51.879677 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 20:39:51.879677 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:39:51.879677 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:39:51.879677 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:39:51.879677 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:39:51.879677 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:39:51.879677 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:39:51.879677 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:39:51.879677 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:39:51.879677 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:39:51.879677 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:39:51.879677 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:39:51.879677 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:39:51.879677 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:39:51.880778 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:39:51.880778 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:39:51.880778 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 20:39:51.880778 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 20:39:51.880778 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 20:39:51.880778 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 20:39:51.880778 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 20:39:51.880778 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 20:39:51.880778 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 15 20:39:51.880778 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:39:51.880778 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 436/874] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jul 15 20:39:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:39:51.885869 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cb1549-2fe3-4868-9f2c-c93c5dd74bd8 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:51.940722 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:39:52.007907 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cb1549-2fe3-4868-9f2c-c93c5dd74bd8 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:52.048684 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e23c686-a23f-4907-abad-2a277ca5b5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:52.049398 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e23c686-a23f-4907-abad-2a277ca5b5da None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:52.049724 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e23c686-a23f-4907-abad-2a277ca5b5da None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:52.050035 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e23c686-a23f-4907-abad-2a277ca5b5da None admin] PATH_INFO: `/v3/users` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:52.050919 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e23c686-a23f-4907-abad-2a277ca5b5da None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:39:52.051231 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e23c686-a23f-4907-abad-2a277ca5b5da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:52.052782 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e23c686-a23f-4907-abad-2a277ca5b5da None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:52.071881 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 439/875] 10.222.0.16 () {56 vars in 1143 bytes} [Fri Jul 15 20:39:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:39:52.078009 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fe1e50-6a20-4bea-9ee6-e997fd239029 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:52.196405 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fe1e50-6a20-4bea-9ee6-e997fd239029 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:52.232179 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78d7e69-fb08-46b6-92fe-99087f5ef145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:52.232887 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d7e69-fb08-46b6-92fe-99087f5ef145 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:52.233232 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d7e69-fb08-46b6-92fe-99087f5ef145 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:52.233547 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d7e69-fb08-46b6-92fe-99087f5ef145 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:52.296857 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:39:52.311787 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78d7e69-fb08-46b6-92fe-99087f5ef145 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:52.313520 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78d7e69-fb08-46b6-92fe-99087f5ef145 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:52.423790 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 437/876] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jul 15 20:39:52 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 20:39:52.429899 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e23c686-a23f-4907-abad-2a277ca5b5da None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:52.544024 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e23c686-a23f-4907-abad-2a277ca5b5da None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:52.553853 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:39:52.580824 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bee753-64a1-46ec-a14f-0be8018dbd05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:52.581636 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bee753-64a1-46ec-a14f-0be8018dbd05 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:52.581919 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bee753-64a1-46ec-a14f-0be8018dbd05 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:52.582228 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bee753-64a1-46ec-a14f-0be8018dbd05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:52.594022 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bee753-64a1-46ec-a14f-0be8018dbd05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:52.595517 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bee753-64a1-46ec-a14f-0be8018dbd05 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:52.614729 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-b2bee753-64a1-46ec-a14f-0be8018dbd05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:39:52.614729 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:39:52.614729 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:39:52.614729 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:39:52.614729 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:39:52.614729 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:39:52.614729 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:39:52.614729 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:39:52.614729 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:39:52.614729 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:39:52.614729 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:39:52.614729 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:39:52.614729 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:39:52.614729 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:39:52.614729 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:39:52.615771 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:39:52.615771 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:39:52.615771 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:39:52.615771 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:39:52.615771 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:39:52.615771 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:39:52.615771 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:39:52.615771 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:39:52.615771 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:39:52.615771 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:39:52.615771 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:39:52.615771 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:39:52.615771 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:39:52.615771 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:39:52.615771 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:39:52.615771 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:39:52.615771 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:39:52.616756 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:39:52.616756 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:39:52.616756 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:39:52.616756 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:39:52.616756 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 440/877] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jul 15 20:39:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:39:52.622105 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78d7e69-fb08-46b6-92fe-99087f5ef145 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:52.716028 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:39:52.728915 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78d7e69-fb08-46b6-92fe-99087f5ef145 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:52.764986 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f96e5d4-b93a-4838-a142-daef3ddcf718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:52.765643 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f96e5d4-b93a-4838-a142-daef3ddcf718 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:52.765926 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f96e5d4-b93a-4838-a142-daef3ddcf718 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:52.766238 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f96e5d4-b93a-4838-a142-daef3ddcf718 None admin] PATH_INFO: `/v3/domains` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:52.766966 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f96e5d4-b93a-4838-a142-daef3ddcf718 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:39:52.767268 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f96e5d4-b93a-4838-a142-daef3ddcf718 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:52.768627 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f96e5d4-b93a-4838-a142-daef3ddcf718 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:52.780610 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 438/878] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jul 15 20:39:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:39:52.786371 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bee753-64a1-46ec-a14f-0be8018dbd05 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:52.887217 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bee753-64a1-46ec-a14f-0be8018dbd05 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:52.922178 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab68d87f-b840-4824-b858-fb316850dab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:52.923200 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68d87f-b840-4824-b858-fb316850dab2 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:52.923485 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68d87f-b840-4824-b858-fb316850dab2 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:52.923760 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68d87f-b840-4824-b858-fb316850dab2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:52.930490 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab68d87f-b840-4824-b858-fb316850dab2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:52.931936 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab68d87f-b840-4824-b858-fb316850dab2 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:52.945726 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-ab68d87f-b840-4824-b858-fb316850dab2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:39:52.945726 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:39:52.945726 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:39:52.945726 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:39:52.945726 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:39:52.945726 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:39:52.945726 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:39:52.945726 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:39:52.945726 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:39:52.945726 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:39:52.945726 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:39:52.945726 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:39:52.945726 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 20:39:52.945726 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 20:39:52.945726 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 20:39:52.946713 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 20:39:52.946713 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:39:52.946713 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:39:52.946713 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:39:52.946713 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:39:52.946713 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:39:52.946713 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:39:52.946713 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:39:52.946713 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:39:52.946713 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:39:52.946713 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:39:52.946713 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:39:52.946713 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:39:52.946713 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:39:52.946713 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:39:52.946713 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:39:52.946713 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:39:52.947575 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 20:39:52.947575 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 20:39:52.947575 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 20:39:52.947575 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 20:39:52.947575 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 20:39:52.947575 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 20:39:52.947575 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:39:52.947575 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:39:52.947575 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 441/879] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jul 15 20:39:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:39:52.953858 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f96e5d4-b93a-4838-a142-daef3ddcf718 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:53.053099 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f96e5d4-b93a-4838-a142-daef3ddcf718 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:53.085318 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25770d01-5565-4ccf-b045-d9fd2315746a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:53.085962 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25770d01-5565-4ccf-b045-d9fd2315746a None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:53.086280 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25770d01-5565-4ccf-b045-d9fd2315746a None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:53.086558 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25770d01-5565-4ccf-b045-d9fd2315746a None admin] PATH_INFO: `/v3/projects` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:53.087328 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25770d01-5565-4ccf-b045-d9fd2315746a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:39:53.087636 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25770d01-5565-4ccf-b045-d9fd2315746a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:53.089055 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25770d01-5565-4ccf-b045-d9fd2315746a None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:53.101168 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 439/880] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jul 15 20:39:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:39:53.107326 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab68d87f-b840-4824-b858-fb316850dab2 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:53.131390 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:39:53.216502 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab68d87f-b840-4824-b858-fb316850dab2 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:53.248878 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f32b1c-e988-42d3-a404-a603ecccbb55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:53.249525 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f32b1c-e988-42d3-a404-a603ecccbb55 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:53.249814 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f32b1c-e988-42d3-a404-a603ecccbb55 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:53.250119 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f32b1c-e988-42d3-a404-a603ecccbb55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:53.250946 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f32b1c-e988-42d3-a404-a603ecccbb55 None admin] RBAC: Adding query filter params (role.id=cbcae224848142ce888ca5b84abfd18e, scope.project.id=0ea017caabac4346a1fc822ddfe3e8c2, user.id=913ad55c6c7b4c41ac22dd0a93ef656c) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:39:53.251261 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f32b1c-e988-42d3-a404-a603ecccbb55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:53.252680 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f32b1c-e988-42d3-a404-a603ecccbb55 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:53.257925 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 442/881] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jul 15 20:39:53 2022] GET /identity/v3/role_assignments?user.id=913ad55c6c7b4c41ac22dd0a93ef656c&scope.project.id=0ea017caabac4346a1fc822ddfe3e8c2&role.id=cbcae224848142ce888ca5b84abfd18e => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:39:55.452165 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30621c4-ca4a-435a-826a-de12d89a5d58 None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:55.452708 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30621c4-ca4a-435a-826a-de12d89a5d58 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:55.452708 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30621c4-ca4a-435a-826a-de12d89a5d58 None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:55.454099 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 440/882] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:39:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:39:55.459451 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0882017f-d2c6-4c7c-ab72-4373a23d7deb None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:55.459890 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0882017f-d2c6-4c7c-ab72-4373a23d7deb None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:55.460010 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0882017f-d2c6-4c7c-ab72-4373a23d7deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:55.477096 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-0882017f-d2c6-4c7c-ab72-4373a23d7deb None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:39:55.478396 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-0882017f-d2c6-4c7c-ab72-4373a23d7deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:39:55.544117 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 443/883] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:39:55 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 20:39:55.567331 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30621c4-ca4a-435a-826a-de12d89a5d58 None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:55.578411 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:39:55.667146 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30621c4-ca4a-435a-826a-de12d89a5d58 None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:55.699900 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ba2600-81b0-43c1-8835-65789400c8a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:55.700675 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba2600-81b0-43c1-8835-65789400c8a9 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:55.700960 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba2600-81b0-43c1-8835-65789400c8a9 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:55.701241 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba2600-81b0-43c1-8835-65789400c8a9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:55.711140 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ba2600-81b0-43c1-8835-65789400c8a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:39:55.719219 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-f2ba2600-81b0-43c1-8835-65789400c8a9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:39:55.719219 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:39:55.719219 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:39:55.719219 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:39:55.719219 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:39:55.719219 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:39:55.719219 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:39:55.719219 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:39:55.719219 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:39:55.719219 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:39:55.719219 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:39:55.719219 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:39:55.719219 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:39:55.719219 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:39:55.719219 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:39:55.719219 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:39:55.720157 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:39:55.720157 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:39:55.720157 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:39:55.720157 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:39:55.720157 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:39:55.720157 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:39:55.720157 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:39:55.720157 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:39:55.720157 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:39:55.720157 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:39:55.720157 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:39:55.720157 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:39:55.720157 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:39:55.720157 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:39:55.720157 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:39:55.720157 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:39:55.720982 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:39:55.720982 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:39:55.720982 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:39:55.720982 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:39:55.720982 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:39:55.720982 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:39:55.720982 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:39:55.720982 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:39:55.720982 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:39:55.720982 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:39:55.720982 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:39:55.720982 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:39:55.720982 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 441/884] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Jul 15 20:39:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:39:55.726406 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0882017f-d2c6-4c7c-ab72-4373a23d7deb None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:55.741787 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:39:55.824434 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0882017f-d2c6-4c7c-ab72-4373a23d7deb None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:55.857020 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fabda8e-7603-41b6-9321-223d9ed0b4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:55.857678 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fabda8e-7603-41b6-9321-223d9ed0b4b4 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:55.857966 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fabda8e-7603-41b6-9321-223d9ed0b4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:55.858276 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fabda8e-7603-41b6-9321-223d9ed0b4b4 None admin] PATH_INFO: `/v3/roles` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:55.859014 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fabda8e-7603-41b6-9321-223d9ed0b4b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:39:55.859327 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fabda8e-7603-41b6-9321-223d9ed0b4b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:55.860690 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fabda8e-7603-41b6-9321-223d9ed0b4b4 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:55.868471 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 444/885] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jul 15 20:39:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:39:55.874256 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ba2600-81b0-43c1-8835-65789400c8a9 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:55.938663 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:39:55.971947 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ba2600-81b0-43c1-8835-65789400c8a9 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:56.003484 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd9375c-3dae-4c94-b575-ca781e44a464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:56.004251 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd9375c-3dae-4c94-b575-ca781e44a464 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:56.004533 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd9375c-3dae-4c94-b575-ca781e44a464 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:56.004810 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd9375c-3dae-4c94-b575-ca781e44a464 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:56.015511 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd9375c-3dae-4c94-b575-ca781e44a464 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:56.016936 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd9375c-3dae-4c94-b575-ca781e44a464 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:56.033992 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-fdd9375c-3dae-4c94-b575-ca781e44a464 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:39:56.033992 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:39:56.033992 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:39:56.033992 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:39:56.033992 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:39:56.033992 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:39:56.033992 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:39:56.033992 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:39:56.033992 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:39:56.033992 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:39:56.033992 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:39:56.033992 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:39:56.033992 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:39:56.033992 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:39:56.033992 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:39:56.035010 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:39:56.035010 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:39:56.035010 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:39:56.035010 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:39:56.035010 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:39:56.035010 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:39:56.035010 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:39:56.035010 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:39:56.035010 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:39:56.035010 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:39:56.035010 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:39:56.035010 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:39:56.035010 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:39:56.035010 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:39:56.035010 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:39:56.035010 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:39:56.035010 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:39:56.036003 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:39:56.036003 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:39:56.036003 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:39:56.036003 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:39:56.036003 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 442/886] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jul 15 20:39:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:39:56.040824 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fabda8e-7603-41b6-9321-223d9ed0b4b4 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:56.114942 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:39:56.141998 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fabda8e-7603-41b6-9321-223d9ed0b4b4 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:56.179029 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ff1627-c330-4852-89e5-ea6c5c089ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:56.179793 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff1627-c330-4852-89e5-ea6c5c089ea9 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:56.180152 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff1627-c330-4852-89e5-ea6c5c089ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:56.180477 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff1627-c330-4852-89e5-ea6c5c089ea9 None admin] PATH_INFO: `/v3/domains` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:56.181365 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ff1627-c330-4852-89e5-ea6c5c089ea9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:39:56.181850 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ff1627-c330-4852-89e5-ea6c5c089ea9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:56.184339 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ff1627-c330-4852-89e5-ea6c5c089ea9 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:56.199611 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 445/887] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jul 15 20:39:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:39:56.205266 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd9375c-3dae-4c94-b575-ca781e44a464 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:56.301310 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd9375c-3dae-4c94-b575-ca781e44a464 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:56.320475 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:39:56.334644 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944c9bb6-d481-4a4f-a9df-b4beeb83dde6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:56.335426 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c9bb6-d481-4a4f-a9df-b4beeb83dde6 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:56.335710 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c9bb6-d481-4a4f-a9df-b4beeb83dde6 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:56.335987 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c9bb6-d481-4a4f-a9df-b4beeb83dde6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:56.343179 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944c9bb6-d481-4a4f-a9df-b4beeb83dde6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:56.344595 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944c9bb6-d481-4a4f-a9df-b4beeb83dde6 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:56.358537 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-944c9bb6-d481-4a4f-a9df-b4beeb83dde6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 15 20:39:56.358537 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:39:56.358537 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:39:56.358537 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:39:56.358537 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:39:56.358537 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:39:56.358537 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:39:56.358537 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:39:56.358537 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:39:56.358537 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:39:56.358537 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:39:56.358537 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:39:56.358537 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 20:39:56.358537 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 20:39:56.358537 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 20:39:56.358537 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 20:39:56.359650 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:39:56.359650 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:39:56.359650 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 20:39:56.359650 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:39:56.359650 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 20:39:56.359650 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:39:56.359650 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:39:56.359650 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:39:56.359650 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:39:56.359650 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:39:56.359650 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:39:56.359650 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:39:56.359650 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:39:56.359650 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:39:56.359650 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:39:56.359650 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:39:56.359650 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:39:56.359650 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:39:56.360829 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:39:56.360829 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:39:56.360829 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 20:39:56.360829 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 20:39:56.360829 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 20:39:56.360829 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 20:39:56.360829 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 20:39:56.360829 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 20:39:56.360829 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 15 20:39:56.360829 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:39:56.360829 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 443/888] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jul 15 20:39:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:39:56.365388 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ff1627-c330-4852-89e5-ea6c5c089ea9 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:56.461383 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ff1627-c330-4852-89e5-ea6c5c089ea9 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:56.494523 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a91d8fa-93c0-4c21-954c-152850137fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:56.495185 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a91d8fa-93c0-4c21-954c-152850137fdd None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:56.495968 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a91d8fa-93c0-4c21-954c-152850137fdd None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:56.496334 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a91d8fa-93c0-4c21-954c-152850137fdd None admin] PATH_INFO: `/v3/users` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:56.497161 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a91d8fa-93c0-4c21-954c-152850137fdd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:39:56.497467 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a91d8fa-93c0-4c21-954c-152850137fdd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:56.498905 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a91d8fa-93c0-4c21-954c-152850137fdd None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:56.501558 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:39:56.516424 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 446/889] 10.222.0.16 () {56 vars in 1143 bytes} [Fri Jul 15 20:39:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:39:56.521989 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944c9bb6-d481-4a4f-a9df-b4beeb83dde6 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:56.622976 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944c9bb6-d481-4a4f-a9df-b4beeb83dde6 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:56.654852 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db44efe-a75e-49e0-9de2-a164c27a9857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:56.655616 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db44efe-a75e-49e0-9de2-a164c27a9857 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:56.655900 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db44efe-a75e-49e0-9de2-a164c27a9857 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:56.656175 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db44efe-a75e-49e0-9de2-a164c27a9857 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:56.666999 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db44efe-a75e-49e0-9de2-a164c27a9857 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:56.669123 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db44efe-a75e-49e0-9de2-a164c27a9857 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:56.685953 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-2db44efe-a75e-49e0-9de2-a164c27a9857 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:39:56.685953 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:39:56.685953 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:39:56.685953 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:39:56.685953 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:39:56.685953 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:39:56.685953 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:39:56.685953 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:39:56.685953 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:39:56.685953 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:39:56.685953 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:39:56.685953 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:39:56.685953 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:39:56.685953 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:39:56.685953 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:39:56.687020 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:39:56.687020 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:39:56.687020 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:39:56.687020 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:39:56.687020 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:39:56.687020 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:39:56.687020 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:39:56.687020 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:39:56.687020 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:39:56.687020 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:39:56.687020 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:39:56.687020 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:39:56.687020 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:39:56.687020 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:39:56.687020 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:39:56.687020 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:39:56.687020 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:39:56.692578 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:39:56.692578 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:39:56.692578 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:39:56.692578 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:39:56.692578 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 444/890] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jul 15 20:39:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:39:56.692947 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a91d8fa-93c0-4c21-954c-152850137fdd None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:56.787942 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a91d8fa-93c0-4c21-954c-152850137fdd None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:56.821119 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa87c56-4d60-4192-a0fa-dea87b6f5772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:56.821772 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa87c56-4d60-4192-a0fa-dea87b6f5772 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:56.822057 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa87c56-4d60-4192-a0fa-dea87b6f5772 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:56.822368 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa87c56-4d60-4192-a0fa-dea87b6f5772 None admin] PATH_INFO: `/v3/domains` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:56.823080 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa87c56-4d60-4192-a0fa-dea87b6f5772 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:39:56.823385 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa87c56-4d60-4192-a0fa-dea87b6f5772 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:56.824770 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa87c56-4d60-4192-a0fa-dea87b6f5772 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:56.835611 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 447/891] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jul 15 20:39:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:39:56.841272 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db44efe-a75e-49e0-9de2-a164c27a9857 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:56.872650 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:39:56.938611 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db44efe-a75e-49e0-9de2-a164c27a9857 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:56.971035 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad99b2f-14a1-4c8b-bf19-42a82b66e690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:56.971798 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad99b2f-14a1-4c8b-bf19-42a82b66e690 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:56.972083 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad99b2f-14a1-4c8b-bf19-42a82b66e690 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:56.972360 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad99b2f-14a1-4c8b-bf19-42a82b66e690 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:56.978820 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad99b2f-14a1-4c8b-bf19-42a82b66e690 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:56.980922 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad99b2f-14a1-4c8b-bf19-42a82b66e690 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:56.994666 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-bad99b2f-14a1-4c8b-bf19-42a82b66e690 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:39:56.994666 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:39:56.994666 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:39:56.994666 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:39:56.994666 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:39:56.994666 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:39:56.994666 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:39:56.994666 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:39:56.994666 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:39:56.994666 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:39:56.994666 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:39:56.994666 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:39:56.994666 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 20:39:56.994666 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 20:39:56.994666 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 20:39:56.995740 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 20:39:56.995740 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:39:56.995740 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:39:56.995740 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:39:56.995740 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:39:56.995740 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:39:56.995740 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:39:56.995740 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:39:56.995740 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:39:56.995740 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:39:56.995740 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:39:56.995740 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:39:56.995740 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:39:56.995740 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:39:56.995740 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:39:56.995740 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:39:56.995740 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:39:56.996661 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 20:39:56.996661 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 20:39:56.996661 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 20:39:56.996661 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 20:39:56.996661 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 20:39:56.996661 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 20:39:56.996661 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:39:56.996661 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:39:56.996661 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 445/892] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jul 15 20:39:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:39:57.001828 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa87c56-4d60-4192-a0fa-dea87b6f5772 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:57.055013 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:39:57.097738 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa87c56-4d60-4192-a0fa-dea87b6f5772 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:57.130919 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fa3e33-56e8-4257-b88a-c8527b7a5b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:57.131581 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa3e33-56e8-4257-b88a-c8527b7a5b4d None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:57.131900 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa3e33-56e8-4257-b88a-c8527b7a5b4d None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:57.132156 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa3e33-56e8-4257-b88a-c8527b7a5b4d None admin] PATH_INFO: `/v3/projects` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:57.132970 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fa3e33-56e8-4257-b88a-c8527b7a5b4d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:39:57.133298 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fa3e33-56e8-4257-b88a-c8527b7a5b4d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:57.134758 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fa3e33-56e8-4257-b88a-c8527b7a5b4d None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:57.147777 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 448/893] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jul 15 20:39:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:39:57.154660 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad99b2f-14a1-4c8b-bf19-42a82b66e690 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:57.243424 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:39:57.252535 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad99b2f-14a1-4c8b-bf19-42a82b66e690 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:57.286192 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99afba55-deda-46fb-91b1-15daf3fcea17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:57.287064 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99afba55-deda-46fb-91b1-15daf3fcea17 None admin] REQUEST_METHOD: `PUT` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:57.287352 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99afba55-deda-46fb-91b1-15daf3fcea17 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:57.287632 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99afba55-deda-46fb-91b1-15daf3fcea17 None admin] PATH_INFO: `/v3/projects/0ea017caabac4346a1fc822ddfe3e8c2/users/913ad55c6c7b4c41ac22dd0a93ef656c/roles/cbcae224848142ce888ca5b84abfd18e` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:57.289557 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99afba55-deda-46fb-91b1-15daf3fcea17 None admin] RBAC: Authorizing `identity:create_grant(project_id=0ea017caabac4346a1fc822ddfe3e8c2, user_id=913ad55c6c7b4c41ac22dd0a93ef656c, role_id=cbcae224848142ce888ca5b84abfd18e)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:57.291009 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99afba55-deda-46fb-91b1-15daf3fcea17 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:57.303038 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 446/894] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Jul 15 20:39:57 2022] PUT /identity/v3/projects/0ea017caabac4346a1fc822ddfe3e8c2/users/913ad55c6c7b4c41ac22dd0a93ef656c/roles/cbcae224848142ce888ca5b84abfd18e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:39:59.516073 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498dff1-8a8e-4e33-9f82-5400c23c01cf None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:59.516502 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498dff1-8a8e-4e33-9f82-5400c23c01cf None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:59.516635 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498dff1-8a8e-4e33-9f82-5400c23c01cf None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:59.517998 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 449/895] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:39:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:39:59.523196 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637846ee-967d-44e8-9025-1f3d57c5ff48 None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:59.523621 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637846ee-967d-44e8-9025-1f3d57c5ff48 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:59.523768 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637846ee-967d-44e8-9025-1f3d57c5ff48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:59.540663 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-637846ee-967d-44e8-9025-1f3d57c5ff48 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:39:59.541863 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-637846ee-967d-44e8-9025-1f3d57c5ff48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:39:59.606883 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 447/896] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:39:59 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 20:39:59.631904 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b498dff1-8a8e-4e33-9f82-5400c23c01cf None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:59.730253 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b498dff1-8a8e-4e33-9f82-5400c23c01cf None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:59.743386 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:39:59.764387 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a4a339-1491-4262-87ff-5b1020660ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:59.765174 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a4a339-1491-4262-87ff-5b1020660ad3 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:59.765460 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a4a339-1491-4262-87ff-5b1020660ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:59.765738 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a4a339-1491-4262-87ff-5b1020660ad3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:59.775982 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a4a339-1491-4262-87ff-5b1020660ad3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:39:59.784219 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-92a4a339-1491-4262-87ff-5b1020660ad3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:39:59.784219 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:39:59.784219 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:39:59.784219 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:39:59.784219 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:39:59.784219 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:39:59.784219 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:39:59.784219 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:39:59.784219 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:39:59.784219 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:39:59.784219 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:39:59.784219 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:39:59.784219 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:39:59.784219 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:39:59.784219 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:39:59.784219 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:39:59.785308 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:39:59.785308 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:39:59.785308 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:39:59.785308 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:39:59.785308 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:39:59.785308 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:39:59.785308 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:39:59.785308 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:39:59.785308 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:39:59.785308 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:39:59.785308 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:39:59.785308 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:39:59.785308 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:39:59.785308 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:39:59.785308 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:39:59.785308 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:39:59.786368 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:39:59.786368 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:39:59.786368 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:39:59.786368 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:39:59.786368 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:39:59.786368 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:39:59.786368 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:39:59.786368 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:39:59.786368 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:39:59.786368 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:39:59.786368 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:39:59.786368 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:39:59.786368 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 450/897] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Jul 15 20:39:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:39:59.791555 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637846ee-967d-44e8-9025-1f3d57c5ff48 None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:59.869430 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:39:59.888936 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637846ee-967d-44e8-9025-1f3d57c5ff48 None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:59.921134 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f208d683-4c28-4322-9919-e8fa4751d28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:59.921785 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f208d683-4c28-4322-9919-e8fa4751d28d None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:59.922099 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f208d683-4c28-4322-9919-e8fa4751d28d None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:59.922382 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f208d683-4c28-4322-9919-e8fa4751d28d None admin] PATH_INFO: `/v3/roles` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:59.923121 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f208d683-4c28-4322-9919-e8fa4751d28d None admin] RBAC: Adding query filter params (name=admin) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:39:59.923432 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f208d683-4c28-4322-9919-e8fa4751d28d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:59.924784 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f208d683-4c28-4322-9919-e8fa4751d28d None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:59.932618 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 448/898] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jul 15 20:39:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:39:59.938807 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a4a339-1491-4262-87ff-5b1020660ad3 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:40:00.034487 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a4a339-1491-4262-87ff-5b1020660ad3 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:40:00.066304 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e96ee4-a404-42a8-a134-d6ca0ee0f35d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:40:00.067078 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e96ee4-a404-42a8-a134-d6ca0ee0f35d None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:40:00.067363 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e96ee4-a404-42a8-a134-d6ca0ee0f35d None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:40:00.067640 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e96ee4-a404-42a8-a134-d6ca0ee0f35d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:40:00.078680 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e96ee4-a404-42a8-a134-d6ca0ee0f35d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:40:00.080106 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e96ee4-a404-42a8-a134-d6ca0ee0f35d None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:40:00.096496 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-e1e96ee4-a404-42a8-a134-d6ca0ee0f35d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:40:00.096496 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:40:00.096496 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:40:00.096496 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:40:00.096496 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:40:00.096496 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:40:00.096496 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:40:00.096496 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:40:00.096496 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:40:00.096496 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:40:00.096496 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:40:00.096496 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:40:00.096496 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:40:00.096496 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:40:00.096496 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:40:00.097542 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:40:00.097542 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:40:00.097542 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:40:00.097542 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:40:00.097542 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:40:00.097542 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:40:00.097542 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:40:00.097542 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:40:00.097542 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:40:00.097542 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:40:00.097542 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:40:00.097542 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:40:00.097542 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:40:00.097542 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:40:00.097542 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:40:00.097542 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:40:00.097542 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:40:00.098681 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:40:00.098681 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:40:00.098681 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:40:00.098681 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:40:00.098681 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 451/899] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jul 15 20:39:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:40:00.103441 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f208d683-4c28-4322-9919-e8fa4751d28d None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:40:00.206423 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f208d683-4c28-4322-9919-e8fa4751d28d None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:40:00.238187 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c4b8fd-924f-4b8c-b849-96b4e703bbe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:40:00.238833 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c4b8fd-924f-4b8c-b849-96b4e703bbe9 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:40:00.239116 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c4b8fd-924f-4b8c-b849-96b4e703bbe9 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:40:00.239394 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c4b8fd-924f-4b8c-b849-96b4e703bbe9 None admin] PATH_INFO: `/v3/domains` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:40:00.240101 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c4b8fd-924f-4b8c-b849-96b4e703bbe9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:40:00.240409 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c4b8fd-924f-4b8c-b849-96b4e703bbe9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:40:00.241771 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c4b8fd-924f-4b8c-b849-96b4e703bbe9 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:40:00.254319 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 449/900] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jul 15 20:40:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:40:00.260092 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e96ee4-a404-42a8-a134-d6ca0ee0f35d None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:40:00.290603 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:40:00.364010 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e96ee4-a404-42a8-a134-d6ca0ee0f35d None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:40:00.396539 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fcdae4-991c-4438-9d79-a148abf6836e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:40:00.397333 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fcdae4-991c-4438-9d79-a148abf6836e None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:40:00.397618 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fcdae4-991c-4438-9d79-a148abf6836e None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:40:00.397893 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fcdae4-991c-4438-9d79-a148abf6836e None admin] PATH_INFO: `/v3/users/placement` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:40:00.405016 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fcdae4-991c-4438-9d79-a148abf6836e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:40:00.406469 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fcdae4-991c-4438-9d79-a148abf6836e None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:40:00.420529 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-e9fcdae4-991c-4438-9d79-a148abf6836e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 15 20:40:00.420529 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:40:00.420529 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:40:00.420529 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:40:00.420529 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:40:00.420529 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:40:00.420529 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:40:00.420529 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:40:00.420529 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:40:00.420529 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:40:00.420529 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:40:00.420529 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:40:00.420529 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 20:40:00.420529 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 20:40:00.420529 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 20:40:00.420529 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 20:40:00.421608 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:40:00.421608 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:40:00.421608 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 20:40:00.421608 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:40:00.421608 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 20:40:00.421608 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:40:00.421608 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:40:00.421608 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:40:00.421608 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:40:00.421608 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:40:00.421608 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:40:00.421608 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:40:00.421608 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:40:00.421608 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:40:00.421608 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:40:00.421608 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:40:00.421608 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:40:00.421608 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:40:00.423029 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:40:00.423029 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:40:00.423029 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 20:40:00.423029 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 20:40:00.423029 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 20:40:00.423029 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 20:40:00.423029 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 20:40:00.423029 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 20:40:00.423029 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 15 20:40:00.423029 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:40:00.423029 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 452/901] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jul 15 20:40:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:40:00.427506 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c4b8fd-924f-4b8c-b849-96b4e703bbe9 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:40:00.431264 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:40:00.525165 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c4b8fd-924f-4b8c-b849-96b4e703bbe9 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:40:00.557986 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f14c320-8ba9-4755-9f85-0bfe14c91544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:40:00.559178 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f14c320-8ba9-4755-9f85-0bfe14c91544 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:40:00.559470 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f14c320-8ba9-4755-9f85-0bfe14c91544 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:40:00.559759 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f14c320-8ba9-4755-9f85-0bfe14c91544 None admin] PATH_INFO: `/v3/users` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:40:00.560589 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f14c320-8ba9-4755-9f85-0bfe14c91544 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:40:00.560906 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f14c320-8ba9-4755-9f85-0bfe14c91544 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:40:00.562401 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f14c320-8ba9-4755-9f85-0bfe14c91544 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:40:00.579334 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 450/902] 10.222.0.16 () {56 vars in 1143 bytes} [Fri Jul 15 20:40:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:40:00.585159 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fcdae4-991c-4438-9d79-a148abf6836e None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:40:00.669792 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:40:00.684586 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fcdae4-991c-4438-9d79-a148abf6836e None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:40:00.716941 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c826412-428b-4028-abc9-059ff16ce124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:40:00.717578 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c826412-428b-4028-abc9-059ff16ce124 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:40:00.717866 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c826412-428b-4028-abc9-059ff16ce124 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:40:00.718175 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c826412-428b-4028-abc9-059ff16ce124 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:40:00.787970 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c826412-428b-4028-abc9-059ff16ce124 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:40:00.789418 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c826412-428b-4028-abc9-059ff16ce124 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:40:00.868601 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:40:00.883430 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 453/903] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jul 15 20:40:00 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 20:40:00.889277 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f14c320-8ba9-4755-9f85-0bfe14c91544 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:40:00.949414 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:40:00.987942 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f14c320-8ba9-4755-9f85-0bfe14c91544 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:40:01.021098 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3b6aec-31ca-4ae5-9ac7-4492dba12fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:40:01.021871 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b6aec-31ca-4ae5-9ac7-4492dba12fe6 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:40:01.022190 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b6aec-31ca-4ae5-9ac7-4492dba12fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:40:01.022475 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b6aec-31ca-4ae5-9ac7-4492dba12fe6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:40:01.032880 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3b6aec-31ca-4ae5-9ac7-4492dba12fe6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:40:01.034345 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3b6aec-31ca-4ae5-9ac7-4492dba12fe6 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:40:01.051825 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-dd3b6aec-31ca-4ae5-9ac7-4492dba12fe6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:40:01.051825 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:40:01.051825 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:40:01.051825 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:40:01.051825 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:40:01.051825 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:40:01.051825 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:40:01.051825 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:40:01.051825 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:40:01.051825 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:40:01.051825 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:40:01.051825 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:40:01.051825 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:40:01.051825 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:40:01.051825 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:40:01.052832 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:40:01.052832 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:40:01.052832 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:40:01.052832 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:40:01.052832 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:40:01.052832 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:40:01.052832 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:40:01.052832 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:40:01.052832 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:40:01.052832 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:40:01.052832 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:40:01.052832 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:40:01.052832 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:40:01.052832 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:40:01.052832 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:40:01.052832 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:40:01.052832 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:40:01.053906 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:40:01.053906 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:40:01.053906 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:40:01.053906 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:40:01.053906 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 451/904] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jul 15 20:40:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:40:01.058886 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c826412-428b-4028-abc9-059ff16ce124 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:40:01.155201 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c826412-428b-4028-abc9-059ff16ce124 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:40:01.186838 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e54e33-4c1d-44f5-a864-420de69f9e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:40:01.187505 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e54e33-4c1d-44f5-a864-420de69f9e6b None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:40:01.187770 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e54e33-4c1d-44f5-a864-420de69f9e6b None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:40:01.188043 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e54e33-4c1d-44f5-a864-420de69f9e6b None admin] PATH_INFO: `/v3/domains` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:40:01.188744 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e54e33-4c1d-44f5-a864-420de69f9e6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:40:01.189048 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e54e33-4c1d-44f5-a864-420de69f9e6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:40:01.190426 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e54e33-4c1d-44f5-a864-420de69f9e6b None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:40:01.201903 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 454/905] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jul 15 20:40:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:40:01.207622 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3b6aec-31ca-4ae5-9ac7-4492dba12fe6 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:40:01.303910 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3b6aec-31ca-4ae5-9ac7-4492dba12fe6 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:40:01.317304 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:40:01.338372 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f39172-4a58-458d-9456-c3ee556a793d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:40:01.339246 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f39172-4a58-458d-9456-c3ee556a793d None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:40:01.340041 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f39172-4a58-458d-9456-c3ee556a793d None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:40:01.340322 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f39172-4a58-458d-9456-c3ee556a793d None admin] PATH_INFO: `/v3/projects/service` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:40:01.346924 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f39172-4a58-458d-9456-c3ee556a793d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:40:01.348361 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f39172-4a58-458d-9456-c3ee556a793d None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:40:01.361833 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application [None req-f9f39172-4a58-458d-9456-c3ee556a793d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:40:01.361833 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:40:01.361833 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:40:01.361833 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:40:01.361833 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:40:01.361833 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:40:01.361833 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:40:01.361833 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:40:01.361833 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:40:01.361833 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:40:01.361833 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:40:01.361833 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:40:01.361833 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 20:40:01.361833 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 20:40:01.361833 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 20:40:01.362751 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 20:40:01.362751 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:40:01.362751 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:40:01.362751 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:40:01.362751 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:40:01.362751 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:40:01.362751 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:40:01.362751 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:40:01.362751 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application with Lock( Jul 15 20:40:01.362751 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:40:01.362751 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:40:01.362751 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:40:01.362751 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:40:01.362751 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:40:01.362751 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:40:01.362751 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:40:01.362751 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:40:01.363635 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 20:40:01.363635 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 20:40:01.363635 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 20:40:01.363635 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 20:40:01.363635 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 20:40:01.363635 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 20:40:01.363635 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:40:01.363635 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: ERROR keystone.server.flask.application Jul 15 20:40:01.363635 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 452/906] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jul 15 20:40:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:40:01.368991 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e54e33-4c1d-44f5-a864-420de69f9e6b None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:40:01.414021 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:40:01.476174 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e54e33-4c1d-44f5-a864-420de69f9e6b None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:40:01.508284 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb2e8d3-5908-40e8-b475-ed91fcdc6415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:40:01.508933 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb2e8d3-5908-40e8-b475-ed91fcdc6415 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:40:01.509217 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb2e8d3-5908-40e8-b475-ed91fcdc6415 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:40:01.509493 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb2e8d3-5908-40e8-b475-ed91fcdc6415 None admin] PATH_INFO: `/v3/projects` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:40:01.510294 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb2e8d3-5908-40e8-b475-ed91fcdc6415 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:40:01.510605 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb2e8d3-5908-40e8-b475-ed91fcdc6415 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:40:01.512611 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb2e8d3-5908-40e8-b475-ed91fcdc6415 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:40:01.524664 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 455/907] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jul 15 20:40:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:40:01.530799 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f39172-4a58-458d-9456-c3ee556a793d None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:40:01.626937 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f39172-4a58-458d-9456-c3ee556a793d None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:40:01.659383 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eefbda-a54c-473c-b0fa-5240d5c85890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:40:01.660023 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eefbda-a54c-473c-b0fa-5240d5c85890 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:40:01.660309 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eefbda-a54c-473c-b0fa-5240d5c85890 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:40:01.660588 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eefbda-a54c-473c-b0fa-5240d5c85890 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:40:01.661396 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eefbda-a54c-473c-b0fa-5240d5c85890 None admin] RBAC: Adding query filter params (role.id=cbcae224848142ce888ca5b84abfd18e, scope.project.id=0ea017caabac4346a1fc822ddfe3e8c2, user.id=913ad55c6c7b4c41ac22dd0a93ef656c) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:40:01.661711 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eefbda-a54c-473c-b0fa-5240d5c85890 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:40:01.663168 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eefbda-a54c-473c-b0fa-5240d5c85890 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:40:01.668854 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 453/908] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jul 15 20:40:01 2022] GET /identity/v3/role_assignments?user.id=913ad55c6c7b4c41ac22dd0a93ef656c&scope.project.id=0ea017caabac4346a1fc822ddfe3e8c2&role.id=cbcae224848142ce888ca5b84abfd18e => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:40:03.910950 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a2dac7-2bda-45b3-bc45-0ebe031c4075 None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:40:03.911467 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a2dac7-2bda-45b3-bc45-0ebe031c4075 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:40:03.911467 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a2dac7-2bda-45b3-bc45-0ebe031c4075 None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:40:03.912741 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 456/909] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:40:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:40:03.918484 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984eea3-9ba2-4100-be33-d2b0c516171b None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:40:03.918885 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984eea3-9ba2-4100-be33-d2b0c516171b None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:40:03.919044 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984eea3-9ba2-4100-be33-d2b0c516171b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:40:03.935302 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-5984eea3-9ba2-4100-be33-d2b0c516171b None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:40:03.936484 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-5984eea3-9ba2-4100-be33-d2b0c516171b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:40:03.965311 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:40:04.002728 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 454/910] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:40:03 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 20:40:04.026035 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a2dac7-2bda-45b3-bc45-0ebe031c4075 None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:40:04.124904 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a2dac7-2bda-45b3-bc45-0ebe031c4075 None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:40:04.132469 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:40:04.162480 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f21184-b02f-43c7-8cc4-3ea4ec9f5f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:40:04.163353 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f21184-b02f-43c7-8cc4-3ea4ec9f5f59 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:40:04.163697 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f21184-b02f-43c7-8cc4-3ea4ec9f5f59 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:40:04.164047 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f21184-b02f-43c7-8cc4-3ea4ec9f5f59 None admin] PATH_INFO: `/v3/services/placement` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:40:04.164764 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f21184-b02f-43c7-8cc4-3ea4ec9f5f59 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:40:04.166414 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f21184-b02f-43c7-8cc4-3ea4ec9f5f59 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:40:04.180095 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-d6f21184-b02f-43c7-8cc4-3ea4ec9f5f59 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 15 20:40:04.180095 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:40:04.180095 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 20:40:04.180095 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 20:40:04.180095 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 20:40:04.180095 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 20:40:04.180095 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 20:40:04.180095 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:40:04.180095 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 15 20:40:04.180095 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:40:04.180095 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 20:40:04.180095 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:40:04.180095 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:40:04.180095 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:40:04.180095 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:40:04.180095 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:40:04.180095 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:40:04.181302 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:40:04.181302 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:40:04.181302 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:40:04.181302 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:40:04.181302 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:40:04.181302 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:40:04.181302 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 20:40:04.181302 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 20:40:04.181302 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 20:40:04.181302 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 20:40:04.181302 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:40:04.181302 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:40:04.181302 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:40:04.181302 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:40:04.181302 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:40:04.181302 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:40:04.182392 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:40:04.182392 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:40:04.182392 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:40:04.182392 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:40:04.182392 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:40:04.182392 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:40:04.182392 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:40:04.182392 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:40:04.182392 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:40:04.182392 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:40:04.182392 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 20:40:04.182392 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:40:04.182392 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 15 20:40:04.182392 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:40:04.182392 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 457/911] 10.222.0.16 () {56 vars in 1117 bytes} [Fri Jul 15 20:40:04 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:40:04.188110 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5984eea3-9ba2-4100-be33-d2b0c516171b None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:40:04.286589 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5984eea3-9ba2-4100-be33-d2b0c516171b None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:40:04.318360 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291efe9e-6d5f-40a4-ae23-6b03ef20269e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:40:04.318964 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291efe9e-6d5f-40a4-ae23-6b03ef20269e None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:40:04.319252 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291efe9e-6d5f-40a4-ae23-6b03ef20269e None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:40:04.319531 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291efe9e-6d5f-40a4-ae23-6b03ef20269e None admin] PATH_INFO: `/v3/services` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:40:04.320474 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291efe9e-6d5f-40a4-ae23-6b03ef20269e None admin] RBAC: Adding query filter params (name=placement) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:40:04.320784 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291efe9e-6d5f-40a4-ae23-6b03ef20269e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:40:04.322171 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291efe9e-6d5f-40a4-ae23-6b03ef20269e None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:40:04.328020 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 455/912] 10.222.0.16 () {56 vars in 1116 bytes} [Fri Jul 15 20:40:04 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:40:04.334645 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f21184-b02f-43c7-8cc4-3ea4ec9f5f59 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:40:04.431541 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f21184-b02f-43c7-8cc4-3ea4ec9f5f59 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:40:04.465777 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5910a34b-4f06-4997-a228-7ea2b6697815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:40:04.466476 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5910a34b-4f06-4997-a228-7ea2b6697815 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:40:04.466763 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5910a34b-4f06-4997-a228-7ea2b6697815 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:40:04.467041 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5910a34b-4f06-4997-a228-7ea2b6697815 None admin] PATH_INFO: `/v3/services` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:40:04.467741 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5910a34b-4f06-4997-a228-7ea2b6697815 None admin] RBAC: Adding query filter params (type=placement) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:40:04.468047 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5910a34b-4f06-4997-a228-7ea2b6697815 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:40:04.469407 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5910a34b-4f06-4997-a228-7ea2b6697815 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:40:04.473816 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 458/913] 10.222.0.16 () {56 vars in 1116 bytes} [Fri Jul 15 20:40:04 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:40:06.675635 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e6e251-924e-45c9-ba07-ee460be0c92c None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:40:06.676160 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e6e251-924e-45c9-ba07-ee460be0c92c None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:40:06.676271 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e6e251-924e-45c9-ba07-ee460be0c92c None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:40:06.677568 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 456/914] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:40:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 20:40:06.683381 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07ee32-9c32-4fd6-b66f-de8d87ed353c None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:40:06.683853 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07ee32-9c32-4fd6-b66f-de8d87ed353c None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:40:06.683946 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07ee32-9c32-4fd6-b66f-de8d87ed353c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:40:06.700757 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-9f07ee32-9c32-4fd6-b66f-de8d87ed353c None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:40:06.701950 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-9f07ee32-9c32-4fd6-b66f-de8d87ed353c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:40:06.728909 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:40:06.770264 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 459/915] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:40:06 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 20:40:06.796755 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e6e251-924e-45c9-ba07-ee460be0c92c None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:40:06.831026 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:40:06.906776 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e6e251-924e-45c9-ba07-ee460be0c92c None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:40:06.942384 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd300e6-0b5e-4ed0-8eed-bea65eab767f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:40:06.943032 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd300e6-0b5e-4ed0-8eed-bea65eab767f None admin] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:40:06.943321 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd300e6-0b5e-4ed0-8eed-bea65eab767f None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:40:06.943968 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd300e6-0b5e-4ed0-8eed-bea65eab767f None admin] PATH_INFO: `/v3/services` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:40:06.944687 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd300e6-0b5e-4ed0-8eed-bea65eab767f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:40:06.946330 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd300e6-0b5e-4ed0-8eed-bea65eab767f None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:40:06.959959 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 457/916] 10.222.0.16 () {60 vars in 1141 bytes} [Fri Jul 15 20:40:06 2022] POST /identity/v3/services => generated 246 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:40:09.241515 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b03050-777c-44e8-a7e3-2147186e256e None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:40:09.242036 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b03050-777c-44e8-a7e3-2147186e256e None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:40:09.242175 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b03050-777c-44e8-a7e3-2147186e256e None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:40:09.243459 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 460/917] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:40:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:40:09.249301 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c5340-86ec-41cb-9d4e-e683e15c8514 None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:40:09.249717 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c5340-86ec-41cb-9d4e-e683e15c8514 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:40:09.249863 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c5340-86ec-41cb-9d4e-e683e15c8514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:40:09.266880 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-6e5c5340-86ec-41cb-9d4e-e683e15c8514 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:40:09.268079 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-6e5c5340-86ec-41cb-9d4e-e683e15c8514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:40:09.338573 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 458/918] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:40:09 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 20:40:09.362095 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b03050-777c-44e8-a7e3-2147186e256e None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:40:09.460694 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b03050-777c-44e8-a7e3-2147186e256e None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:40:09.496642 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc8579-4d5e-4cbb-97ec-9d3599135880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:40:09.497372 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc8579-4d5e-4cbb-97ec-9d3599135880 None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:40:09.497650 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc8579-4d5e-4cbb-97ec-9d3599135880 None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:40:09.497922 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc8579-4d5e-4cbb-97ec-9d3599135880 None admin] PATH_INFO: `/v3/services/placement` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:40:09.498591 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfc8579-4d5e-4cbb-97ec-9d3599135880 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:40:09.499953 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfc8579-4d5e-4cbb-97ec-9d3599135880 None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:40:09.511630 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-ddfc8579-4d5e-4cbb-97ec-9d3599135880 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 15 20:40:09.511630 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:40:09.511630 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 20:40:09.511630 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 20:40:09.511630 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 20:40:09.511630 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 20:40:09.511630 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 20:40:09.511630 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:40:09.511630 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 15 20:40:09.511630 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:40:09.511630 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 20:40:09.511630 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:40:09.511630 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:40:09.511630 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:40:09.511630 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:40:09.511630 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:40:09.511630 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:40:09.512744 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:40:09.512744 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:40:09.512744 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:40:09.512744 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:40:09.512744 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:40:09.512744 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:40:09.512744 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 20:40:09.512744 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 20:40:09.512744 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 20:40:09.512744 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 20:40:09.512744 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:40:09.512744 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:40:09.512744 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:40:09.512744 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:40:09.512744 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:40:09.512744 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:40:09.513914 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:40:09.513914 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:40:09.513914 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:40:09.513914 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:40:09.513914 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:40:09.513914 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:40:09.513914 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:40:09.513914 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:40:09.513914 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:40:09.513914 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:40:09.513914 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 20:40:09.513914 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:40:09.513914 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 15 20:40:09.513914 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:40:09.513914 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 461/919] 10.222.0.16 () {56 vars in 1117 bytes} [Fri Jul 15 20:40:09 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:40:09.518788 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c5340-86ec-41cb-9d4e-e683e15c8514 None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:40:09.536549 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:40:09.615582 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c5340-86ec-41cb-9d4e-e683e15c8514 None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:40:09.647899 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6e389a-56c2-4a08-8e96-648684de2df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:40:09.648549 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e389a-56c2-4a08-8e96-648684de2df8 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:40:09.648838 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e389a-56c2-4a08-8e96-648684de2df8 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:40:09.649117 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e389a-56c2-4a08-8e96-648684de2df8 None admin] PATH_INFO: `/v3/services` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:40:09.649809 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6e389a-56c2-4a08-8e96-648684de2df8 None admin] RBAC: Adding query filter params (name=placement) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:40:09.650165 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6e389a-56c2-4a08-8e96-648684de2df8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:40:09.651526 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6e389a-56c2-4a08-8e96-648684de2df8 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:40:09.656922 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 459/920] 10.222.0.16 () {56 vars in 1116 bytes} [Fri Jul 15 20:40:09 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:40:09.662837 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc8579-4d5e-4cbb-97ec-9d3599135880 None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:40:09.691291 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:40:09.761463 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc8579-4d5e-4cbb-97ec-9d3599135880 None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:40:09.794724 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c80c837-e84c-432b-b08f-5d3d83b2edac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:40:09.795373 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c80c837-e84c-432b-b08f-5d3d83b2edac None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:40:09.795657 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c80c837-e84c-432b-b08f-5d3d83b2edac None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:40:09.795934 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c80c837-e84c-432b-b08f-5d3d83b2edac None admin] PATH_INFO: `/v3/endpoints` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:40:09.796711 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c80c837-e84c-432b-b08f-5d3d83b2edac None admin] RBAC: Adding query filter params (interface=public, service_id=cde1baf78eed4699b72733a51cef77f3, region_id=RegionOne) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:40:09.797022 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c80c837-e84c-432b-b08f-5d3d83b2edac None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:40:09.798403 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c80c837-e84c-432b-b08f-5d3d83b2edac None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:40:09.803419 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 462/921] 10.222.0.16 () {56 vars in 1251 bytes} [Fri Jul 15 20:40:09 2022] GET /identity/v3/endpoints?service_id=cde1baf78eed4699b72733a51cef77f3&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:40:09.809110 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6e389a-56c2-4a08-8e96-648684de2df8 None admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:40:09.890934 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:40:09.909767 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6e389a-56c2-4a08-8e96-648684de2df8 None admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:40:09.943600 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fb0f26-a29b-41b8-837c-a2907157f32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:40:09.944257 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb0f26-a29b-41b8-837c-a2907157f32a None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:40:09.944549 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb0f26-a29b-41b8-837c-a2907157f32a None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:40:09.944832 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb0f26-a29b-41b8-837c-a2907157f32a None admin] PATH_INFO: `/v3/services` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:40:09.945764 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fb0f26-a29b-41b8-837c-a2907157f32a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:40:09.947160 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fb0f26-a29b-41b8-837c-a2907157f32a None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:40:09.953532 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 460/922] 10.222.0.16 () {56 vars in 1087 bytes} [Fri Jul 15 20:40:09 2022] GET /identity/v3/services => generated 1962 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:40:12.164456 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3dc5f5-9a63-4124-8e28-966903232b5d None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:40:12.164982 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3dc5f5-9a63-4124-8e28-966903232b5d None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:40:12.165093 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3dc5f5-9a63-4124-8e28-966903232b5d None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:40:12.166511 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 463/923] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:40:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:40:12.171725 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd3ea7-ac55-4f8b-84ea-d18543c33477 None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:40:12.172155 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd3ea7-ac55-4f8b-84ea-d18543c33477 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:40:12.172289 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd3ea7-ac55-4f8b-84ea-d18543c33477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:40:12.189151 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-83fd3ea7-ac55-4f8b-84ea-d18543c33477 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:40:12.190390 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-83fd3ea7-ac55-4f8b-84ea-d18543c33477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:40:12.264036 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 461/924] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:40:12 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 20:40:12.287329 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3dc5f5-9a63-4124-8e28-966903232b5d None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:40:12.378648 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:40:12.388235 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3dc5f5-9a63-4124-8e28-966903232b5d None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:40:12.420308 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7094fa22-836b-40bc-9b62-bbd52bf6cdef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:40:12.421031 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7094fa22-836b-40bc-9b62-bbd52bf6cdef None admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:40:12.421312 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7094fa22-836b-40bc-9b62-bbd52bf6cdef None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:40:12.421587 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7094fa22-836b-40bc-9b62-bbd52bf6cdef None admin] PATH_INFO: `/v3/services/placement` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:40:12.422253 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7094fa22-836b-40bc-9b62-bbd52bf6cdef None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:40:12.423598 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7094fa22-836b-40bc-9b62-bbd52bf6cdef None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:40:12.435633 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application [None req-7094fa22-836b-40bc-9b62-bbd52bf6cdef None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 15 20:40:12.435633 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:40:12.435633 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 20:40:12.435633 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 20:40:12.435633 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 20:40:12.435633 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 20:40:12.435633 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 20:40:12.435633 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:40:12.435633 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 15 20:40:12.435633 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:40:12.435633 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 20:40:12.435633 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:40:12.435633 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:40:12.435633 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:40:12.435633 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:40:12.435633 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:40:12.435633 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:40:12.436781 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:40:12.436781 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:40:12.436781 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:40:12.436781 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:40:12.436781 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:40:12.436781 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:40:12.436781 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 20:40:12.436781 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 20:40:12.436781 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 20:40:12.436781 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 20:40:12.436781 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:40:12.436781 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:40:12.436781 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:40:12.436781 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:40:12.436781 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:40:12.436781 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:40:12.437808 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:40:12.437808 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application with Lock( Jul 15 20:40:12.437808 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:40:12.437808 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:40:12.437808 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:40:12.437808 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:40:12.437808 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:40:12.437808 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:40:12.437808 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:40:12.437808 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:40:12.437808 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 20:40:12.437808 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:40:12.437808 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 15 20:40:12.437808 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: ERROR keystone.server.flask.application Jul 15 20:40:12.437808 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 464/925] 10.222.0.16 () {56 vars in 1117 bytes} [Fri Jul 15 20:40:12 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:40:12.442847 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fd3ea7-ac55-4f8b-84ea-d18543c33477 None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:40:12.518559 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:40:12.541015 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fd3ea7-ac55-4f8b-84ea-d18543c33477 None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:40:12.574859 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382aa7f6-2fd0-48b2-baa1-4a3a9a98fb83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:40:12.575510 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382aa7f6-2fd0-48b2-baa1-4a3a9a98fb83 None admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:40:12.575800 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382aa7f6-2fd0-48b2-baa1-4a3a9a98fb83 None admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:40:12.576082 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382aa7f6-2fd0-48b2-baa1-4a3a9a98fb83 None admin] PATH_INFO: `/v3/services` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:40:12.576787 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382aa7f6-2fd0-48b2-baa1-4a3a9a98fb83 None admin] RBAC: Adding query filter params (name=placement) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:40:12.577098 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382aa7f6-2fd0-48b2-baa1-4a3a9a98fb83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:40:12.578507 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382aa7f6-2fd0-48b2-baa1-4a3a9a98fb83 None admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:40:12.583491 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 462/926] 10.222.0.16 () {56 vars in 1116 bytes} [Fri Jul 15 20:40:12 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:40:12.589398 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7094fa22-836b-40bc-9b62-bbd52bf6cdef None admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:40:12.687804 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7094fa22-836b-40bc-9b62-bbd52bf6cdef None admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:40:12.720641 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6bd3ec-037b-4d6b-bf56-6a014c8d30bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:40:12.721290 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6bd3ec-037b-4d6b-bf56-6a014c8d30bd None admin] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:40:12.721577 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6bd3ec-037b-4d6b-bf56-6a014c8d30bd None admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:40:12.721857 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6bd3ec-037b-4d6b-bf56-6a014c8d30bd None admin] PATH_INFO: `/v3/endpoints` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:40:12.722628 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6bd3ec-037b-4d6b-bf56-6a014c8d30bd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:40:12.723993 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6bd3ec-037b-4d6b-bf56-6a014c8d30bd None admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:40:12.743889 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 465/927] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Jul 15 20:40:12 2022] POST /identity/v3/endpoints => generated 331 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:40:22.580529 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=30 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:40:22.740285 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:41:10.639675 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a9045-467b-4716-bcd8-4eae27f576e1 None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:41:10.640187 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a9045-467b-4716-bcd8-4eae27f576e1 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:41:10.640266 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a9045-467b-4716-bcd8-4eae27f576e1 None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:41:10.642255 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 463/928] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:41:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:41:10.647641 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67967061-2277-4ec2-8db4-cb90458658b8 None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:41:10.648196 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67967061-2277-4ec2-8db4-cb90458658b8 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:41:10.648196 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67967061-2277-4ec2-8db4-cb90458658b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:41:10.676850 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-67967061-2277-4ec2-8db4-cb90458658b8 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:41:10.683330 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-67967061-2277-4ec2-8db4-cb90458658b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:41:10.778162 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 466/929] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:41:10 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:41:10.829801 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ff339-368a-4f5a-9a48-a79b8d016d77 None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:41:10.830114 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ff339-368a-4f5a-9a48-a79b8d016d77 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:41:10.830404 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ff339-368a-4f5a-9a48-a79b8d016d77 None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:41:10.831893 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 464/930] 10.222.0.16 () {54 vars in 964 bytes} [Fri Jul 15 20:41:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:41:10.837882 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f14ed2-e417-42a0-90ea-9f6c64300e3b None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:41:10.838170 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f14ed2-e417-42a0-90ea-9f6c64300e3b None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:41:10.838407 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f14ed2-e417-42a0-90ea-9f6c64300e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:41:10.917694 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-86f14ed2-e417-42a0-90ea-9f6c64300e3b None None] MFA Rules not processed for user `3491680e892041678242f9b93617b9a6`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:41:10.920189 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-86f14ed2-e417-42a0-90ea-9f6c64300e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:41:11.006565 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 467/931] 10.222.0.16 () {58 vars in 1061 bytes} [Fri Jul 15 20:41:10 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 20:41:11.016267 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0ff339-368a-4f5a-9a48-a79b8d016d77 None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:41:11.030968 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0ff339-368a-4f5a-9a48-a79b8d016d77 None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:41:11.034908 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f78d2-1414-42ac-a4eb-57d046b1d97c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3491680e892041678242f9b93617b9a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:41:11.035816 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f78d2-1414-42ac-a4eb-57d046b1d97c service neutron] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:41:11.036121 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f78d2-1414-42ac-a4eb-57d046b1d97c service neutron] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:41:11.036490 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f78d2-1414-42ac-a4eb-57d046b1d97c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:41:11.049729 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01f78d2-1414-42ac-a4eb-57d046b1d97c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:41:11.051359 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01f78d2-1414-42ac-a4eb-57d046b1d97c service neutron] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:41:11.064425 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 465/932] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:41:11 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:41:13.580771 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43420740-9a4b-47b0-8c91-edac49e6aff9 None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:41:13.581316 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43420740-9a4b-47b0-8c91-edac49e6aff9 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:41:13.581316 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43420740-9a4b-47b0-8c91-edac49e6aff9 None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:41:13.582713 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 468/933] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:41:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:41:13.587923 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8eee4-4969-4085-8e95-fc1fc9cf79ec None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:41:13.588353 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8eee4-4969-4085-8e95-fc1fc9cf79ec None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:41:13.588488 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8eee4-4969-4085-8e95-fc1fc9cf79ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:41:13.606979 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-30a8eee4-4969-4085-8e95-fc1fc9cf79ec None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:41:13.608169 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-30a8eee4-4969-4085-8e95-fc1fc9cf79ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:41:13.615756 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 466/934] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:41:13 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:41:13.670222 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6b180-7cc5-4661-b068-dcb28fb01f5d None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:41:13.670513 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6b180-7cc5-4661-b068-dcb28fb01f5d None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:41:13.670804 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6b180-7cc5-4661-b068-dcb28fb01f5d None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:41:13.672158 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 469/935] 10.222.0.16 () {54 vars in 964 bytes} [Fri Jul 15 20:41:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:41:13.678262 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5629eb1f-e8d8-4877-b66d-5bae6f440d72 None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:41:13.678501 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5629eb1f-e8d8-4877-b66d-5bae6f440d72 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:41:13.678780 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5629eb1f-e8d8-4877-b66d-5bae6f440d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:41:13.697017 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-5629eb1f-e8d8-4877-b66d-5bae6f440d72 None None] MFA Rules not processed for user `3491680e892041678242f9b93617b9a6`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:41:13.698225 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-5629eb1f-e8d8-4877-b66d-5bae6f440d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:41:13.704880 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 467/936] 10.222.0.16 () {58 vars in 1061 bytes} [Fri Jul 15 20:41:13 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 20:41:13.713749 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d6b180-7cc5-4661-b068-dcb28fb01f5d None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:41:13.727638 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d6b180-7cc5-4661-b068-dcb28fb01f5d None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:41:13.731123 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21dd4cd-5524-4e51-8bdd-adac29a8457b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3491680e892041678242f9b93617b9a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:41:13.731765 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21dd4cd-5524-4e51-8bdd-adac29a8457b service neutron] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:41:13.732058 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21dd4cd-5524-4e51-8bdd-adac29a8457b service neutron] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:41:13.732337 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21dd4cd-5524-4e51-8bdd-adac29a8457b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:41:13.741606 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21dd4cd-5524-4e51-8bdd-adac29a8457b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:41:13.743078 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21dd4cd-5524-4e51-8bdd-adac29a8457b service neutron] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:41:13.752648 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 470/937] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:41:13 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:41:16.554415 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6739456b-4a5b-4e73-ad1e-2c732561b6f6 None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:41:16.554938 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6739456b-4a5b-4e73-ad1e-2c732561b6f6 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:41:16.555031 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6739456b-4a5b-4e73-ad1e-2c732561b6f6 None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:41:16.560188 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 468/938] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:41:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:41:16.561751 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a7480b-8118-42c1-a71a-e30431e75622 None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:41:16.562219 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a7480b-8118-42c1-a71a-e30431e75622 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:41:16.562385 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a7480b-8118-42c1-a71a-e30431e75622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:41:16.600022 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-52a7480b-8118-42c1-a71a-e30431e75622 None None] MFA Rules not processed for user `bbd59331bbaf47468ccbb663718c3841`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:41:16.601229 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-52a7480b-8118-42c1-a71a-e30431e75622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:41:16.656728 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:41:16.686333 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 471/939] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:41:16 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 20:41:16.727363 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6739456b-4a5b-4e73-ad1e-2c732561b6f6 None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:41:16.739088 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6739456b-4a5b-4e73-ad1e-2c732561b6f6 None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:41:16.742546 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ece073-2198-4084-9862-068f35f4a534 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3491680e892041678242f9b93617b9a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:41:16.743188 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ece073-2198-4084-9862-068f35f4a534 service neutron] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:41:16.743483 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ece073-2198-4084-9862-068f35f4a534 service neutron] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:41:16.743762 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ece073-2198-4084-9862-068f35f4a534 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:41:16.753172 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ece073-2198-4084-9862-068f35f4a534 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:41:16.754670 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ece073-2198-4084-9862-068f35f4a534 service neutron] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:41:16.768912 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 469/940] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:41:16 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:41:19.615983 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e9b3ee-6a8b-4586-af5c-b2768d6a5b03 None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:41:19.616497 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e9b3ee-6a8b-4586-af5c-b2768d6a5b03 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:41:19.616585 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e9b3ee-6a8b-4586-af5c-b2768d6a5b03 None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:41:19.617885 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 472/941] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:41:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:41:19.623684 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc4e4d-1349-4c73-a959-8c7e6b617e9d None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:41:19.624056 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc4e4d-1349-4c73-a959-8c7e6b617e9d None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:41:19.624237 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc4e4d-1349-4c73-a959-8c7e6b617e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:41:19.641929 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-5bcc4e4d-1349-4c73-a959-8c7e6b617e9d None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:41:19.643128 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-5bcc4e4d-1349-4c73-a959-8c7e6b617e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:41:19.709415 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 470/942] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:41:19 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:41:19.749890 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e9b3ee-6a8b-4586-af5c-b2768d6a5b03 None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:41:19.760363 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e9b3ee-6a8b-4586-af5c-b2768d6a5b03 None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:41:19.763812 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1705d5-f198-4e10-b661-00efb8b7d891 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3491680e892041678242f9b93617b9a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:41:19.764446 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1705d5-f198-4e10-b661-00efb8b7d891 service neutron] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:41:19.764732 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1705d5-f198-4e10-b661-00efb8b7d891 service neutron] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:41:19.765009 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1705d5-f198-4e10-b661-00efb8b7d891 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:41:19.773783 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1705d5-f198-4e10-b661-00efb8b7d891 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:41:19.775269 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1705d5-f198-4e10-b661-00efb8b7d891 service neutron] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:41:19.785539 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 473/943] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:41:19 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:41:22.726761 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaaeb4b-fb93-4921-850e-0916a7f10e20 None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:41:22.727330 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaaeb4b-fb93-4921-850e-0916a7f10e20 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:41:22.727330 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaaeb4b-fb93-4921-850e-0916a7f10e20 None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:41:22.728692 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 471/944] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:41:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:41:22.734668 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929cc5d2-031a-4dd8-988d-68e139bf567e None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:41:22.735096 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929cc5d2-031a-4dd8-988d-68e139bf567e None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:41:22.735233 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929cc5d2-031a-4dd8-988d-68e139bf567e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:41:22.755270 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-929cc5d2-031a-4dd8-988d-68e139bf567e None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:41:22.756455 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-929cc5d2-031a-4dd8-988d-68e139bf567e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:41:22.766636 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 474/945] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:41:22 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:41:22.804316 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaaeb4b-fb93-4921-850e-0916a7f10e20 None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:41:22.815476 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaaeb4b-fb93-4921-850e-0916a7f10e20 None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:41:22.818917 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520eec29-56e5-44c0-bd5c-cefe7c8e6b30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3491680e892041678242f9b93617b9a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:41:22.819557 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520eec29-56e5-44c0-bd5c-cefe7c8e6b30 service neutron] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:41:22.819842 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520eec29-56e5-44c0-bd5c-cefe7c8e6b30 service neutron] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:41:22.820120 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520eec29-56e5-44c0-bd5c-cefe7c8e6b30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:41:22.829496 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520eec29-56e5-44c0-bd5c-cefe7c8e6b30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:41:22.830956 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520eec29-56e5-44c0-bd5c-cefe7c8e6b30 service neutron] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:41:22.840205 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 472/946] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:41:22 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:41:25.119126 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d547ea-e918-481b-81c4-e93b476ff84a None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:41:25.119678 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d547ea-e918-481b-81c4-e93b476ff84a None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:41:25.119678 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d547ea-e918-481b-81c4-e93b476ff84a None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:41:25.120909 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 475/947] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:41:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:41:25.126197 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8837a3df-bee8-4d69-ab12-f9528e388f1d None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:41:25.126655 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8837a3df-bee8-4d69-ab12-f9528e388f1d None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:41:25.126904 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8837a3df-bee8-4d69-ab12-f9528e388f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:41:25.145274 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-8837a3df-bee8-4d69-ab12-f9528e388f1d None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:41:25.146559 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-8837a3df-bee8-4d69-ab12-f9528e388f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:41:25.154722 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 473/948] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:41:25 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:41:25.190939 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d547ea-e918-481b-81c4-e93b476ff84a None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:41:25.202271 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d547ea-e918-481b-81c4-e93b476ff84a None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:41:25.205703 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc1855-2cba-4e57-b181-1cc8543741ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3491680e892041678242f9b93617b9a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:41:25.206372 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc1855-2cba-4e57-b181-1cc8543741ed service neutron] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:41:25.206655 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc1855-2cba-4e57-b181-1cc8543741ed service neutron] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:41:25.206926 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc1855-2cba-4e57-b181-1cc8543741ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:41:25.216282 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dc1855-2cba-4e57-b181-1cc8543741ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:41:25.217698 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dc1855-2cba-4e57-b181-1cc8543741ed service neutron] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:41:25.226799 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 476/949] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:41:25 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:41:27.525006 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03578e1-1ce3-4833-a8da-40c0e5b720e7 None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:41:27.525565 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03578e1-1ce3-4833-a8da-40c0e5b720e7 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:41:27.525565 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03578e1-1ce3-4833-a8da-40c0e5b720e7 None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:41:27.526996 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 474/950] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:41:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:41:27.532958 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de368cf-76dd-49c9-a5b4-665860d62074 None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:41:27.533483 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de368cf-76dd-49c9-a5b4-665860d62074 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:41:27.533593 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de368cf-76dd-49c9-a5b4-665860d62074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:41:27.551384 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-0de368cf-76dd-49c9-a5b4-665860d62074 None None] MFA Rules not processed for user `bbd59331bbaf47468ccbb663718c3841`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:41:27.552583 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-0de368cf-76dd-49c9-a5b4-665860d62074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:41:27.560829 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 477/951] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:41:27 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:41:27.599800 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03578e1-1ce3-4833-a8da-40c0e5b720e7 None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:41:27.611049 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03578e1-1ce3-4833-a8da-40c0e5b720e7 None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:41:27.614479 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4e7edc-9824-4437-81f7-8f0d657a5e39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3491680e892041678242f9b93617b9a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:41:27.615109 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e7edc-9824-4437-81f7-8f0d657a5e39 service neutron] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:41:27.615393 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e7edc-9824-4437-81f7-8f0d657a5e39 service neutron] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:41:27.615667 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e7edc-9824-4437-81f7-8f0d657a5e39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:41:27.624490 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4e7edc-9824-4437-81f7-8f0d657a5e39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:41:27.625913 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4e7edc-9824-4437-81f7-8f0d657a5e39 service neutron] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:41:27.635205 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 475/952] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:41:27 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:41:30.090839 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e3b469-cacd-469a-ac6e-594a83fe11b6 None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:41:30.091388 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e3b469-cacd-469a-ac6e-594a83fe11b6 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:41:30.091388 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e3b469-cacd-469a-ac6e-594a83fe11b6 None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:41:30.092748 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 478/953] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:41:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:41:30.098501 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211b1f3-b411-4850-b001-2ecdf2853d50 None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:41:30.099084 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211b1f3-b411-4850-b001-2ecdf2853d50 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:41:30.099084 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211b1f3-b411-4850-b001-2ecdf2853d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:41:30.117533 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-a211b1f3-b411-4850-b001-2ecdf2853d50 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:41:30.118701 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-a211b1f3-b411-4850-b001-2ecdf2853d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:41:30.128481 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 476/954] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:41:30 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:41:30.166374 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e3b469-cacd-469a-ac6e-594a83fe11b6 None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:41:30.177832 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e3b469-cacd-469a-ac6e-594a83fe11b6 None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:41:30.181523 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120b0ec8-5a62-45af-872b-94302fd6ea47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3491680e892041678242f9b93617b9a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:41:30.182238 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b0ec8-5a62-45af-872b-94302fd6ea47 service neutron] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:41:30.182544 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b0ec8-5a62-45af-872b-94302fd6ea47 service neutron] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:41:30.182824 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b0ec8-5a62-45af-872b-94302fd6ea47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:41:30.193122 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120b0ec8-5a62-45af-872b-94302fd6ea47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:41:30.194619 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120b0ec8-5a62-45af-872b-94302fd6ea47 service neutron] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:41:30.205658 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 479/955] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:41:30 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:41:32.524955 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c0c19b-d619-47a1-bce6-fe90b9bba7bf None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:41:32.525497 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c0c19b-d619-47a1-bce6-fe90b9bba7bf None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:41:32.525497 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c0c19b-d619-47a1-bce6-fe90b9bba7bf None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:41:32.526925 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 477/956] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:41:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:41:32.533412 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de971a0-b4e8-4265-9d65-6a1b3efbedbd None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:41:32.533930 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de971a0-b4e8-4265-9d65-6a1b3efbedbd None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:41:32.534467 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de971a0-b4e8-4265-9d65-6a1b3efbedbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:41:32.553247 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-4de971a0-b4e8-4265-9d65-6a1b3efbedbd None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:41:32.554491 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-4de971a0-b4e8-4265-9d65-6a1b3efbedbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:41:32.562927 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 480/957] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:41:32 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:41:32.604187 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c0c19b-d619-47a1-bce6-fe90b9bba7bf None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:41:32.610091 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=68 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:41:32.616409 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c0c19b-d619-47a1-bce6-fe90b9bba7bf None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:41:32.619889 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6b1736-ca19-4cb2-b3c5-9148c802f071 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3491680e892041678242f9b93617b9a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:41:32.620526 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b1736-ca19-4cb2-b3c5-9148c802f071 service neutron] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:41:32.621381 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b1736-ca19-4cb2-b3c5-9148c802f071 service neutron] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:41:32.621665 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b1736-ca19-4cb2-b3c5-9148c802f071 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:41:32.630593 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6b1736-ca19-4cb2-b3c5-9148c802f071 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:41:32.631973 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6b1736-ca19-4cb2-b3c5-9148c802f071 service neutron] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:41:32.641319 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 478/958] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:41:32 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:41:35.538167 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e521f65-a2e1-4c3b-af91-a4116411f3b6 None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:41:35.538717 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e521f65-a2e1-4c3b-af91-a4116411f3b6 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:41:35.538717 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e521f65-a2e1-4c3b-af91-a4116411f3b6 None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:41:35.540083 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 481/959] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:41:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:41:35.545705 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6882cd7a-f86a-44fb-bf1a-b60d929b198e None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:41:35.546146 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6882cd7a-f86a-44fb-bf1a-b60d929b198e None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:41:35.546365 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6882cd7a-f86a-44fb-bf1a-b60d929b198e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:41:35.564314 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-6882cd7a-f86a-44fb-bf1a-b60d929b198e None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:41:35.565852 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-6882cd7a-f86a-44fb-bf1a-b60d929b198e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:41:35.574363 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 479/960] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:41:35 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:41:35.611689 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e521f65-a2e1-4c3b-af91-a4116411f3b6 None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:41:35.622068 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e521f65-a2e1-4c3b-af91-a4116411f3b6 None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:41:35.625531 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe465fb1-de16-445a-a369-23a6397d1b21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3491680e892041678242f9b93617b9a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:41:35.626208 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe465fb1-de16-445a-a369-23a6397d1b21 service neutron] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:41:35.626497 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe465fb1-de16-445a-a369-23a6397d1b21 service neutron] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:41:35.626777 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe465fb1-de16-445a-a369-23a6397d1b21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:41:35.635472 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe465fb1-de16-445a-a369-23a6397d1b21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:41:35.637403 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe465fb1-de16-445a-a369-23a6397d1b21 service neutron] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:41:35.646586 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 482/961] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:41:35 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:41:39.916447 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7484bf74-d339-43fe-b891-3e4b07e83bcd None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:41:39.916950 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7484bf74-d339-43fe-b891-3e4b07e83bcd None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:41:39.917026 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7484bf74-d339-43fe-b891-3e4b07e83bcd None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:41:39.918941 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 480/962] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:41:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:41:39.924171 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3d3a92-b67c-4289-a241-7780da61cdf2 None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:41:39.924607 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3d3a92-b67c-4289-a241-7780da61cdf2 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:41:39.924735 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3d3a92-b67c-4289-a241-7780da61cdf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:41:39.942207 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-9b3d3a92-b67c-4289-a241-7780da61cdf2 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:41:39.943385 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-9b3d3a92-b67c-4289-a241-7780da61cdf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:41:39.951377 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 483/963] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:41:39 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 20:41:39.991860 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7484bf74-d339-43fe-b891-3e4b07e83bcd None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:41:40.002411 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7484bf74-d339-43fe-b891-3e4b07e83bcd None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:41:40.005818 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ea74ac-48a0-4c46-a7a3-6a90a3e42252 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3491680e892041678242f9b93617b9a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:41:40.006473 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ea74ac-48a0-4c46-a7a3-6a90a3e42252 service neutron] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:41:40.006760 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ea74ac-48a0-4c46-a7a3-6a90a3e42252 service neutron] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:41:40.007035 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ea74ac-48a0-4c46-a7a3-6a90a3e42252 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:41:40.016340 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ea74ac-48a0-4c46-a7a3-6a90a3e42252 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:41:40.017748 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ea74ac-48a0-4c46-a7a3-6a90a3e42252 service neutron] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:41:40.029906 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 481/964] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:41:39 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:41:42.854172 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4eddcf-66fe-4a8e-ae92-60fc8a9b5945 None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:41:42.854691 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4eddcf-66fe-4a8e-ae92-60fc8a9b5945 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:41:42.854793 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4eddcf-66fe-4a8e-ae92-60fc8a9b5945 None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:41:42.856159 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 484/965] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:41:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:41:42.866711 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8df034-ee6d-419e-a9d4-f992ad179206 None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:41:42.867168 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8df034-ee6d-419e-a9d4-f992ad179206 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:41:42.867279 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8df034-ee6d-419e-a9d4-f992ad179206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:41:42.885905 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-dd8df034-ee6d-419e-a9d4-f992ad179206 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:41:42.887765 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-dd8df034-ee6d-419e-a9d4-f992ad179206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:41:42.896500 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 482/966] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:41:42 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:41:42.936562 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4eddcf-66fe-4a8e-ae92-60fc8a9b5945 None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:41:42.949325 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4eddcf-66fe-4a8e-ae92-60fc8a9b5945 None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:41:42.952927 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a6bc9e-be5b-4b26-9793-307b8ea8f492 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3491680e892041678242f9b93617b9a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:41:42.953570 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a6bc9e-be5b-4b26-9793-307b8ea8f492 service neutron] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:41:42.953856 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a6bc9e-be5b-4b26-9793-307b8ea8f492 service neutron] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:41:42.954166 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a6bc9e-be5b-4b26-9793-307b8ea8f492 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:41:42.963350 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a6bc9e-be5b-4b26-9793-307b8ea8f492 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:41:42.964773 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a6bc9e-be5b-4b26-9793-307b8ea8f492 service neutron] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:41:42.974298 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 485/967] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:41:42 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:41:47.142660 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b316e-e4ac-44ef-9ac6-e8dd0e4d40d1 None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:41:47.143179 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b316e-e4ac-44ef-9ac6-e8dd0e4d40d1 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:41:47.143266 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b316e-e4ac-44ef-9ac6-e8dd0e4d40d1 None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:41:47.144599 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 483/968] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:41:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:41:47.149902 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b48faa6-ee76-487b-b4a6-7d261b3fdcef None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:41:47.150335 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b48faa6-ee76-487b-b4a6-7d261b3fdcef None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:41:47.150488 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b48faa6-ee76-487b-b4a6-7d261b3fdcef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:41:47.156449 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=54 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:41:47.169289 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-6b48faa6-ee76-487b-b4a6-7d261b3fdcef None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:41:47.170515 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-6b48faa6-ee76-487b-b4a6-7d261b3fdcef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:41:47.178441 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 486/969] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:41:47 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:41:47.218271 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68b316e-e4ac-44ef-9ac6-e8dd0e4d40d1 None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:41:47.228913 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68b316e-e4ac-44ef-9ac6-e8dd0e4d40d1 None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:41:47.232338 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0836a47a-4dab-4d31-84b7-a99b41d35cc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3491680e892041678242f9b93617b9a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:41:47.232967 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836a47a-4dab-4d31-84b7-a99b41d35cc5 service neutron] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:41:47.233250 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836a47a-4dab-4d31-84b7-a99b41d35cc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:41:47.233525 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836a47a-4dab-4d31-84b7-a99b41d35cc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:41:47.242228 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0836a47a-4dab-4d31-84b7-a99b41d35cc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:41:47.243644 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0836a47a-4dab-4d31-84b7-a99b41d35cc5 service neutron] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:41:47.253321 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 484/970] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:41:47 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:41:52.784037 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222578ce-5dbf-491e-b663-7338c128135f None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:41:52.784866 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222578ce-5dbf-491e-b663-7338c128135f None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:41:52.785278 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222578ce-5dbf-491e-b663-7338c128135f None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:41:52.790594 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 487/971] 10.222.0.16 () {54 vars in 921 bytes} [Fri Jul 15 20:41:52 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:41:52.796735 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d5b644-9a84-4f02-9847-df4ff034a730 None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:41:52.797563 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d5b644-9a84-4f02-9847-df4ff034a730 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:41:52.798609 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d5b644-9a84-4f02-9847-df4ff034a730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:41:52.861435 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-67d5b644-9a84-4f02-9847-df4ff034a730 None None] MFA Rules not processed for user `913ad55c6c7b4c41ac22dd0a93ef656c`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:41:52.863051 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-67d5b644-9a84-4f02-9847-df4ff034a730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:41:52.942209 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 485/972] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Jul 15 20:41:52 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:41:57.166098 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=2 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:41:57.412920 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393720b2-4b0e-4258-ba0f-8bc516f27bf5 None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:41:57.413275 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393720b2-4b0e-4258-ba0f-8bc516f27bf5 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:41:57.413498 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393720b2-4b0e-4258-ba0f-8bc516f27bf5 None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:41:57.415055 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 488/973] 10.222.0.16 () {54 vars in 921 bytes} [Fri Jul 15 20:41:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:41:57.419967 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e1a71-975b-4836-914d-32d00ce48120 None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:41:57.420465 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e1a71-975b-4836-914d-32d00ce48120 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:41:57.420744 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e1a71-975b-4836-914d-32d00ce48120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:41:57.439283 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-546e1a71-975b-4836-914d-32d00ce48120 None None] MFA Rules not processed for user `913ad55c6c7b4c41ac22dd0a93ef656c`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:41:57.440633 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-546e1a71-975b-4836-914d-32d00ce48120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:41:57.450831 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 486/974] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Jul 15 20:41:57 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:41:59.001616 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7ecf8-f67f-4f30-936b-2c4a0897fa55 None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:41:59.002185 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7ecf8-f67f-4f30-936b-2c4a0897fa55 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:41:59.002185 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7ecf8-f67f-4f30-936b-2c4a0897fa55 None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:41:59.003514 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 489/975] 10.222.0.16 () {54 vars in 921 bytes} [Fri Jul 15 20:41:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:41:59.008362 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff4fd0-7b15-4709-ba1f-2fbe84e562d4 None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:41:59.008754 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff4fd0-7b15-4709-ba1f-2fbe84e562d4 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:41:59.009204 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff4fd0-7b15-4709-ba1f-2fbe84e562d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:41:59.027620 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-7aff4fd0-7b15-4709-ba1f-2fbe84e562d4 None None] MFA Rules not processed for user `913ad55c6c7b4c41ac22dd0a93ef656c`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:41:59.028905 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-7aff4fd0-7b15-4709-ba1f-2fbe84e562d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:41:59.037668 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 487/976] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Jul 15 20:41:59 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 20:42:02.874757 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9713989-c5b6-40c7-820f-6d7a820e9c78 None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:02.875274 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9713989-c5b6-40c7-820f-6d7a820e9c78 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:02.875469 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9713989-c5b6-40c7-820f-6d7a820e9c78 None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:02.877056 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 490/977] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:42:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:42:02.882391 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c735f-ecd7-41c4-a6d0-abdeaed5d796 None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:02.882841 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c735f-ecd7-41c4-a6d0-abdeaed5d796 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:02.882950 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c735f-ecd7-41c4-a6d0-abdeaed5d796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:02.889294 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=69 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:42:02.903055 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-e24c735f-ecd7-41c4-a6d0-abdeaed5d796 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:42:02.904241 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-e24c735f-ecd7-41c4-a6d0-abdeaed5d796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:42:02.912345 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 488/978] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:42:02 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:42:02.967309 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e14dd10-6370-4e17-937b-3c571dc260a5 None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:02.967912 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e14dd10-6370-4e17-937b-3c571dc260a5 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:02.968078 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e14dd10-6370-4e17-937b-3c571dc260a5 None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:02.969677 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 491/979] 10.222.0.16 () {54 vars in 961 bytes} [Fri Jul 15 20:42:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:42:02.979062 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8910fb05-6a58-4c09-98bb-b6033a837324 None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:02.980182 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8910fb05-6a58-4c09-98bb-b6033a837324 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:02.980595 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8910fb05-6a58-4c09-98bb-b6033a837324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:03.021324 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-8910fb05-6a58-4c09-98bb-b6033a837324 None None] MFA Rules not processed for user `b3e5296637584004b1888453ab9056c4`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:42:03.022658 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-8910fb05-6a58-4c09-98bb-b6033a837324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:42:03.097786 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 489/980] 10.222.0.16 () {58 vars in 1058 bytes} [Fri Jul 15 20:42:02 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:42:03.106644 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e14dd10-6370-4e17-937b-3c571dc260a5 None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:42:03.121641 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e14dd10-6370-4e17-937b-3c571dc260a5 None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:42:03.127224 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0b2068-6c8f-4c3b-8e15-f244eef98804 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e5296637584004b1888453ab9056c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:42:03.127898 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b2068-6c8f-4c3b-8e15-f244eef98804 service nova] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:03.128187 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b2068-6c8f-4c3b-8e15-f244eef98804 service nova] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:03.128464 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b2068-6c8f-4c3b-8e15-f244eef98804 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:03.137760 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0b2068-6c8f-4c3b-8e15-f244eef98804 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:42:03.139461 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0b2068-6c8f-4c3b-8e15-f244eef98804 service nova] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:42:03.150213 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 492/981] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:42:03 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:42:05.608758 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92909d72-345c-47ff-9242-3dd2a52af5b4 None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:05.609276 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92909d72-345c-47ff-9242-3dd2a52af5b4 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:05.609356 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92909d72-345c-47ff-9242-3dd2a52af5b4 None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:05.610861 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 490/982] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:42:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:42:05.615753 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4263c48e-c539-40d6-87f2-dd5190a60e9f None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:05.616810 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4263c48e-c539-40d6-87f2-dd5190a60e9f None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:05.617298 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4263c48e-c539-40d6-87f2-dd5190a60e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:05.636392 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-4263c48e-c539-40d6-87f2-dd5190a60e9f None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:42:05.637906 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-4263c48e-c539-40d6-87f2-dd5190a60e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:42:05.645762 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 493/983] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:42:05 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:42:05.693189 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92909d72-345c-47ff-9242-3dd2a52af5b4 None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:42:05.707186 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92909d72-345c-47ff-9242-3dd2a52af5b4 None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:42:05.712700 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7cd8f5-2ec1-4df4-b7fe-7b52128c39f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e5296637584004b1888453ab9056c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:42:05.713353 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7cd8f5-2ec1-4df4-b7fe-7b52128c39f0 service nova] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:05.713646 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7cd8f5-2ec1-4df4-b7fe-7b52128c39f0 service nova] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:05.714116 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7cd8f5-2ec1-4df4-b7fe-7b52128c39f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:05.725468 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7cd8f5-2ec1-4df4-b7fe-7b52128c39f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:42:05.727193 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7cd8f5-2ec1-4df4-b7fe-7b52128c39f0 service nova] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:42:05.738292 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 491/984] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:42:05 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:42:08.292854 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ccac1-fd57-4995-80a9-d12a4f8dd4c9 None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:08.293374 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ccac1-fd57-4995-80a9-d12a4f8dd4c9 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:08.293484 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ccac1-fd57-4995-80a9-d12a4f8dd4c9 None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:08.294802 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 494/985] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:42:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:42:08.300031 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a51e3-6b15-40fd-a1ec-6b98a9483ae4 None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:08.300433 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a51e3-6b15-40fd-a1ec-6b98a9483ae4 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:08.300602 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a51e3-6b15-40fd-a1ec-6b98a9483ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:08.318831 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-0e6a51e3-6b15-40fd-a1ec-6b98a9483ae4 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:42:08.320026 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-0e6a51e3-6b15-40fd-a1ec-6b98a9483ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:42:08.328779 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 492/986] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:42:08 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:42:08.374891 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11426ce6-1576-48ab-b374-11dde4dd44a2 None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:08.375179 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11426ce6-1576-48ab-b374-11dde4dd44a2 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:08.375459 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11426ce6-1576-48ab-b374-11dde4dd44a2 None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:08.376794 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 495/987] 10.222.0.16 () {54 vars in 961 bytes} [Fri Jul 15 20:42:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:42:08.382064 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f01c79-de7c-4039-ac26-fd55df2168a8 None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:08.382396 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f01c79-de7c-4039-ac26-fd55df2168a8 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:08.382677 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f01c79-de7c-4039-ac26-fd55df2168a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:08.401182 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-06f01c79-de7c-4039-ac26-fd55df2168a8 None None] MFA Rules not processed for user `b3e5296637584004b1888453ab9056c4`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:42:08.402389 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-06f01c79-de7c-4039-ac26-fd55df2168a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:42:08.412488 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 493/988] 10.222.0.16 () {58 vars in 1058 bytes} [Fri Jul 15 20:42:08 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:42:08.421366 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11426ce6-1576-48ab-b374-11dde4dd44a2 None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:42:08.438105 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11426ce6-1576-48ab-b374-11dde4dd44a2 None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:42:08.443906 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a98e70-a215-4945-962e-dcc3c55cf2a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e5296637584004b1888453ab9056c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:42:08.444551 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a98e70-a215-4945-962e-dcc3c55cf2a8 service nova] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:08.444838 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a98e70-a215-4945-962e-dcc3c55cf2a8 service nova] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:08.445117 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a98e70-a215-4945-962e-dcc3c55cf2a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:08.454746 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a98e70-a215-4945-962e-dcc3c55cf2a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:42:08.456340 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a98e70-a215-4945-962e-dcc3c55cf2a8 service nova] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:42:08.466841 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 496/989] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:42:08 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 20:42:10.949833 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75fb934-18c1-4738-9758-72f964aba044 None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:10.951443 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75fb934-18c1-4738-9758-72f964aba044 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:10.951911 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75fb934-18c1-4738-9758-72f964aba044 None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:10.962246 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 494/990] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:42:10 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:42:10.964276 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dbce8c-e737-4ef1-aa0d-edf9ab2ac814 None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:10.964810 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dbce8c-e737-4ef1-aa0d-edf9ab2ac814 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:10.965561 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dbce8c-e737-4ef1-aa0d-edf9ab2ac814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:10.992014 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-57dbce8c-e737-4ef1-aa0d-edf9ab2ac814 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:42:10.998091 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-57dbce8c-e737-4ef1-aa0d-edf9ab2ac814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:42:11.018706 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 497/991] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:42:10 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:42:11.077695 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75fb934-18c1-4738-9758-72f964aba044 None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:42:11.098400 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75fb934-18c1-4738-9758-72f964aba044 None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:42:11.105306 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04398708-8533-4561-b855-6cf49f019cd6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e5296637584004b1888453ab9056c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:42:11.106185 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04398708-8533-4561-b855-6cf49f019cd6 service nova] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:11.106711 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04398708-8533-4561-b855-6cf49f019cd6 service nova] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:11.107136 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04398708-8533-4561-b855-6cf49f019cd6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:11.117638 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04398708-8533-4561-b855-6cf49f019cd6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:42:11.119752 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04398708-8533-4561-b855-6cf49f019cd6 service nova] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:42:11.144709 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 495/992] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:42:11 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:42:13.228970 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f30068-107c-42f2-858f-918eb18f9ebb None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:13.230307 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f30068-107c-42f2-858f-918eb18f9ebb None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:13.231019 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f30068-107c-42f2-858f-918eb18f9ebb None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:13.239545 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 498/993] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:42:13 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:42:13.239735 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c5801-0631-45a2-90bd-3bbfe1d18030 None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:13.240354 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c5801-0631-45a2-90bd-3bbfe1d18030 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:13.240442 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c5801-0631-45a2-90bd-3bbfe1d18030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:13.270388 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-1e4c5801-0631-45a2-90bd-3bbfe1d18030 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:42:13.271911 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-1e4c5801-0631-45a2-90bd-3bbfe1d18030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:42:13.291078 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 496/994] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:42:13 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:42:13.601279 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9445a9-5571-49e7-9c1c-23bff08d9d51 None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:13.601572 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9445a9-5571-49e7-9c1c-23bff08d9d51 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:13.601855 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9445a9-5571-49e7-9c1c-23bff08d9d51 None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:13.603444 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 499/995] 10.222.0.16 () {54 vars in 963 bytes} [Fri Jul 15 20:42:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:42:13.608632 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a771c1-6ebe-49a3-a0a4-92287abd6472 None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:13.608927 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a771c1-6ebe-49a3-a0a4-92287abd6472 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:13.609206 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a771c1-6ebe-49a3-a0a4-92287abd6472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:13.649107 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-69a771c1-6ebe-49a3-a0a4-92287abd6472 None None] MFA Rules not processed for user `d50ee89209d2474b8609861ed0a513e6`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:42:13.650353 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-69a771c1-6ebe-49a3-a0a4-92287abd6472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:42:13.724473 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 497/996] 10.222.0.16 () {58 vars in 1060 bytes} [Fri Jul 15 20:42:13 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:42:13.732769 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9445a9-5571-49e7-9c1c-23bff08d9d51 None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:42:13.735973 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86617056-343f-49d1-853a-3db35bc7805f None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:13.736377 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86617056-343f-49d1-853a-3db35bc7805f None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:13.736577 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86617056-343f-49d1-853a-3db35bc7805f None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:13.737991 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 498/997] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:42:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 20:42:13.742817 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a24116-f6d6-43f0-83ae-0dcbfd90cb02 None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:13.743104 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a24116-f6d6-43f0-83ae-0dcbfd90cb02 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:13.743384 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a24116-f6d6-43f0-83ae-0dcbfd90cb02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:13.745952 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9445a9-5571-49e7-9c1c-23bff08d9d51 None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:42:13.751364 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3206f1d-2656-4be2-ad4c-e462a9f74849 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd50ee89209d2474b8609861ed0a513e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:42:13.752361 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3206f1d-2656-4be2-ad4c-e462a9f74849 service cinder] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:13.752933 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3206f1d-2656-4be2-ad4c-e462a9f74849 service cinder] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:13.753209 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3206f1d-2656-4be2-ad4c-e462a9f74849 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:13.764162 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-86a24116-f6d6-43f0-83ae-0dcbfd90cb02 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:42:13.765470 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-86a24116-f6d6-43f0-83ae-0dcbfd90cb02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:42:13.768482 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3206f1d-2656-4be2-ad4c-e462a9f74849 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:42:13.770543 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3206f1d-2656-4be2-ad4c-e462a9f74849 service cinder] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:42:13.774129 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 499/998] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:42:13 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 20:42:13.781124 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 500/999] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:42:13 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 20:42:13.820444 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a24116-f6d6-43f0-83ae-0dcbfd90cb02 None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:42:13.828826 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:42:13.833210 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a24116-f6d6-43f0-83ae-0dcbfd90cb02 None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:42:13.839006 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aa19fe-37b8-49a6-a476-975c57db1d91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e5296637584004b1888453ab9056c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:42:13.839653 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa19fe-37b8-49a6-a476-975c57db1d91 service nova] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:13.839940 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa19fe-37b8-49a6-a476-975c57db1d91 service nova] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:13.840222 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa19fe-37b8-49a6-a476-975c57db1d91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:13.848474 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aa19fe-37b8-49a6-a476-975c57db1d91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:42:13.850113 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aa19fe-37b8-49a6-a476-975c57db1d91 service nova] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:42:13.860273 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 500/1000] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:42:13 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:42:16.178686 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30c893-b769-43cb-a637-c0aad7e046b8 None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:16.179189 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30c893-b769-43cb-a637-c0aad7e046b8 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:16.179309 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30c893-b769-43cb-a637-c0aad7e046b8 None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:16.180600 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 501/1001] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:42:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:42:16.186041 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b36276-7b56-41e0-9aa2-22b5e71a711e None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:16.186450 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b36276-7b56-41e0-9aa2-22b5e71a711e None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:16.186539 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b36276-7b56-41e0-9aa2-22b5e71a711e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:16.205508 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-28b36276-7b56-41e0-9aa2-22b5e71a711e None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:42:16.206725 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-28b36276-7b56-41e0-9aa2-22b5e71a711e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:42:16.215203 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 501/1002] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:42:16 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:42:16.259924 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d30c893-b769-43cb-a637-c0aad7e046b8 None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:42:16.274299 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d30c893-b769-43cb-a637-c0aad7e046b8 None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:42:16.279928 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f554d4d9-9e63-4dcc-8077-c48cdead639a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e5296637584004b1888453ab9056c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:42:16.280583 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f554d4d9-9e63-4dcc-8077-c48cdead639a service nova] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:16.280874 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f554d4d9-9e63-4dcc-8077-c48cdead639a service nova] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:16.281156 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f554d4d9-9e63-4dcc-8077-c48cdead639a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:16.289987 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f554d4d9-9e63-4dcc-8077-c48cdead639a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:42:16.291556 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f554d4d9-9e63-4dcc-8077-c48cdead639a service nova] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:42:16.301582 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 502/1003] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:42:16 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:42:18.629625 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea1c1bc-c407-41fc-a613-03f54af5834a None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:18.630231 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea1c1bc-c407-41fc-a613-03f54af5834a None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:18.630231 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea1c1bc-c407-41fc-a613-03f54af5834a None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:18.631567 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 502/1004] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:42:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:42:18.637355 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16208f93-8ba4-46db-b88c-2f54154775cb None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:18.637890 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16208f93-8ba4-46db-b88c-2f54154775cb None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:18.638022 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16208f93-8ba4-46db-b88c-2f54154775cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:18.662452 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-16208f93-8ba4-46db-b88c-2f54154775cb None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:42:18.663660 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-16208f93-8ba4-46db-b88c-2f54154775cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:42:18.671752 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 503/1005] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:42:18 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:42:18.716281 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea1c1bc-c407-41fc-a613-03f54af5834a None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:42:18.729906 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea1c1bc-c407-41fc-a613-03f54af5834a None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:42:18.734917 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4a135d-a6a1-4508-9024-6cc1612b17f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e5296637584004b1888453ab9056c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:42:18.735552 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4a135d-a6a1-4508-9024-6cc1612b17f1 service nova] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:18.735842 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4a135d-a6a1-4508-9024-6cc1612b17f1 service nova] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:18.736124 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4a135d-a6a1-4508-9024-6cc1612b17f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:18.744417 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4a135d-a6a1-4508-9024-6cc1612b17f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:42:18.746583 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4a135d-a6a1-4508-9024-6cc1612b17f1 service nova] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:42:18.756342 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 503/1006] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:42:18 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:42:21.021206 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6fba48-34ed-4abe-90c8-4a85ae6db118 None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:21.021705 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6fba48-34ed-4abe-90c8-4a85ae6db118 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:21.021705 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6fba48-34ed-4abe-90c8-4a85ae6db118 None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:21.023041 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 504/1007] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:42:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:42:21.028231 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d31e6e-855d-4a8b-9eda-d498aafc1f2c None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:21.028667 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d31e6e-855d-4a8b-9eda-d498aafc1f2c None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:21.028779 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d31e6e-855d-4a8b-9eda-d498aafc1f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:21.046510 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-e7d31e6e-855d-4a8b-9eda-d498aafc1f2c None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:42:21.047715 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-e7d31e6e-855d-4a8b-9eda-d498aafc1f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:42:21.056101 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 504/1008] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:42:21 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:42:21.102205 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6fba48-34ed-4abe-90c8-4a85ae6db118 None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:42:21.117160 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6fba48-34ed-4abe-90c8-4a85ae6db118 None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:42:21.122651 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d1f827-0a00-4293-8d3d-d6ab154bcdb9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e5296637584004b1888453ab9056c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:42:21.123370 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d1f827-0a00-4293-8d3d-d6ab154bcdb9 service nova] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:21.123752 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d1f827-0a00-4293-8d3d-d6ab154bcdb9 service nova] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:21.124098 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d1f827-0a00-4293-8d3d-d6ab154bcdb9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:21.132570 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d1f827-0a00-4293-8d3d-d6ab154bcdb9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:42:21.134203 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d1f827-0a00-4293-8d3d-d6ab154bcdb9 service nova] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:42:21.144623 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 505/1009] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:42:21 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:42:24.262434 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de6b1d-e3ec-4e21-b0c1-c3b85810d273 None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:24.266142 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de6b1d-e3ec-4e21-b0c1-c3b85810d273 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:24.266142 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de6b1d-e3ec-4e21-b0c1-c3b85810d273 None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:24.270696 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 505/1010] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:42:24 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:42:24.277228 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146580e7-97a1-4904-b98a-4c5bddb77623 None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:24.278066 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146580e7-97a1-4904-b98a-4c5bddb77623 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:24.278066 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146580e7-97a1-4904-b98a-4c5bddb77623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:24.300218 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-146580e7-97a1-4904-b98a-4c5bddb77623 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:42:24.301964 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-146580e7-97a1-4904-b98a-4c5bddb77623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:42:24.312807 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 506/1011] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:42:24 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:42:24.360168 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5de6b1d-e3ec-4e21-b0c1-c3b85810d273 None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:42:24.375035 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5de6b1d-e3ec-4e21-b0c1-c3b85810d273 None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:42:24.380335 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cacf511-f266-462f-b837-d1343744dcc0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e5296637584004b1888453ab9056c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:42:24.380989 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cacf511-f266-462f-b837-d1343744dcc0 service nova] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:24.381320 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cacf511-f266-462f-b837-d1343744dcc0 service nova] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:24.381600 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cacf511-f266-462f-b837-d1343744dcc0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:24.390395 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cacf511-f266-462f-b837-d1343744dcc0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:42:24.392019 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cacf511-f266-462f-b837-d1343744dcc0 service nova] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:42:24.401766 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 506/1012] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:42:24 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 20:42:27.428711 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c82567-01ca-48ae-84b1-7d31342b65ab None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:27.429387 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c82567-01ca-48ae-84b1-7d31342b65ab None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:27.429387 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c82567-01ca-48ae-84b1-7d31342b65ab None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:27.430725 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 507/1013] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:42:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:42:27.436096 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c602d1d-a5ac-426c-9ab4-0554e80af804 None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:27.436564 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c602d1d-a5ac-426c-9ab4-0554e80af804 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:27.436668 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c602d1d-a5ac-426c-9ab4-0554e80af804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:27.456126 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-3c602d1d-a5ac-426c-9ab4-0554e80af804 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:42:27.457311 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-3c602d1d-a5ac-426c-9ab4-0554e80af804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:42:27.465803 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 507/1014] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:42:27 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:42:27.510830 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c82567-01ca-48ae-84b1-7d31342b65ab None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:42:27.518960 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=43 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:42:27.525786 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c82567-01ca-48ae-84b1-7d31342b65ab None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:42:27.531311 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63034053-a880-4c1f-845c-f71c2e594eb2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e5296637584004b1888453ab9056c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:42:27.531954 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63034053-a880-4c1f-845c-f71c2e594eb2 service nova] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:27.532243 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63034053-a880-4c1f-845c-f71c2e594eb2 service nova] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:27.532524 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63034053-a880-4c1f-845c-f71c2e594eb2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:27.540841 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63034053-a880-4c1f-845c-f71c2e594eb2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:42:27.542459 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63034053-a880-4c1f-845c-f71c2e594eb2 service nova] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:42:27.551758 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 508/1015] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:42:27 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:42:29.681748 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be2c58-0a5b-4d5a-ab5a-db4ab9617ab1 None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:29.682483 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be2c58-0a5b-4d5a-ab5a-db4ab9617ab1 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:29.682483 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be2c58-0a5b-4d5a-ab5a-db4ab9617ab1 None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:29.683747 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 508/1016] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:42:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:42:29.689762 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd5595-fa2f-4aa9-84ea-fa8f5d6adb21 None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:29.690427 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd5595-fa2f-4aa9-84ea-fa8f5d6adb21 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:29.690427 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd5595-fa2f-4aa9-84ea-fa8f5d6adb21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:29.709267 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-8abd5595-fa2f-4aa9-84ea-fa8f5d6adb21 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:42:29.710519 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-8abd5595-fa2f-4aa9-84ea-fa8f5d6adb21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:42:29.718799 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 509/1017] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:42:29 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:42:29.774671 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb90cbc-e44d-4bbd-a6dd-eaac01799be5 None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:29.774962 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb90cbc-e44d-4bbd-a6dd-eaac01799be5 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:29.775244 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb90cbc-e44d-4bbd-a6dd-eaac01799be5 None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:29.776739 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 509/1018] 10.222.0.16 () {54 vars in 960 bytes} [Fri Jul 15 20:42:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:42:29.782334 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1bf499-45e7-445a-a4f9-41c7cb00d74e None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:29.782629 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1bf499-45e7-445a-a4f9-41c7cb00d74e None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:29.782911 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1bf499-45e7-445a-a4f9-41c7cb00d74e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:29.817951 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-cc1bf499-45e7-445a-a4f9-41c7cb00d74e None None] MFA Rules not processed for user `2766cf20921045a896ff7735cc2534d6`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:42:29.819173 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-cc1bf499-45e7-445a-a4f9-41c7cb00d74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:42:29.835555 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b89a065-e576-464c-a363-c599a82715a9 None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:29.835853 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b89a065-e576-464c-a363-c599a82715a9 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:29.836139 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b89a065-e576-464c-a363-c599a82715a9 None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:29.837619 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 510/1019] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:42:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:42:29.842316 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d99bc90-a8de-4997-9144-ad4e7feb8611 None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:29.842607 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d99bc90-a8de-4997-9144-ad4e7feb8611 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:29.842887 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d99bc90-a8de-4997-9144-ad4e7feb8611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:29.861267 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-5d99bc90-a8de-4997-9144-ad4e7feb8611 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:42:29.862506 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-5d99bc90-a8de-4997-9144-ad4e7feb8611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:42:29.870238 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 511/1020] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:42:29 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 20:42:29.884045 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 510/1021] 10.222.0.16 () {58 vars in 1057 bytes} [Fri Jul 15 20:42:29 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:42:29.892080 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d99bc90-a8de-4997-9144-ad4e7feb8611 None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:42:29.901471 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d99bc90-a8de-4997-9144-ad4e7feb8611 None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:42:29.906391 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bef31ba-db6b-4cf9-b2f2-0b1c86a40f55 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2766cf20921045a896ff7735cc2534d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:42:29.907039 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef31ba-db6b-4cf9-b2f2-0b1c86a40f55 service glance] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:29.907327 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef31ba-db6b-4cf9-b2f2-0b1c86a40f55 service glance] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:29.907605 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef31ba-db6b-4cf9-b2f2-0b1c86a40f55 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:29.915253 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1bf499-45e7-445a-a4f9-41c7cb00d74e None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:42:29.917485 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bef31ba-db6b-4cf9-b2f2-0b1c86a40f55 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:42:29.918962 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bef31ba-db6b-4cf9-b2f2-0b1c86a40f55 service glance] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:42:29.927222 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1bf499-45e7-445a-a4f9-41c7cb00d74e None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:42:29.928334 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 512/1022] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:42:29 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:42:29.932314 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21d92e9-17bf-4bc0-80ea-7eaff90e3204 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e5296637584004b1888453ab9056c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:42:29.932950 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d92e9-17bf-4bc0-80ea-7eaff90e3204 service nova] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:29.933776 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d92e9-17bf-4bc0-80ea-7eaff90e3204 service nova] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:29.934056 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d92e9-17bf-4bc0-80ea-7eaff90e3204 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:29.942291 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21d92e9-17bf-4bc0-80ea-7eaff90e3204 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:42:29.943876 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21d92e9-17bf-4bc0-80ea-7eaff90e3204 service nova] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:42:29.955770 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 511/1023] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:42:29 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 20:42:32.243991 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e28c7-9856-46c2-a2e6-cc3be6d8a803 None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:32.244698 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e28c7-9856-46c2-a2e6-cc3be6d8a803 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:32.244698 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e28c7-9856-46c2-a2e6-cc3be6d8a803 None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:32.246508 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 513/1024] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:42:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:42:32.251686 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c007cc-2dac-41d7-989a-6ea8e42d94a8 None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:32.252140 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c007cc-2dac-41d7-989a-6ea8e42d94a8 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:32.252232 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c007cc-2dac-41d7-989a-6ea8e42d94a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:32.271578 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-51c007cc-2dac-41d7-989a-6ea8e42d94a8 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:42:32.272775 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-51c007cc-2dac-41d7-989a-6ea8e42d94a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:42:32.280703 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 512/1025] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:42:32 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:42:32.328394 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168e28c7-9856-46c2-a2e6-cc3be6d8a803 None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:42:32.343742 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168e28c7-9856-46c2-a2e6-cc3be6d8a803 None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:42:32.348781 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c51ca-324f-4dfc-9816-3c9808f35dfa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e5296637584004b1888453ab9056c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:42:32.349460 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c51ca-324f-4dfc-9816-3c9808f35dfa service nova] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:32.349747 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c51ca-324f-4dfc-9816-3c9808f35dfa service nova] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:32.350026 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c51ca-324f-4dfc-9816-3c9808f35dfa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:32.361353 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8c51ca-324f-4dfc-9816-3c9808f35dfa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:42:32.362973 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8c51ca-324f-4dfc-9816-3c9808f35dfa service nova] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:42:32.375173 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 514/1026] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:42:32 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:42:42.265233 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=50 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:42:42.368714 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=40 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:42:45.258742 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba21b16b-bff8-4ff8-beef-bdce4235c8d3 None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:45.259364 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba21b16b-bff8-4ff8-beef-bdce4235c8d3 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:45.259364 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba21b16b-bff8-4ff8-beef-bdce4235c8d3 None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:45.260642 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 513/1027] 10.222.0.16 () {54 vars in 918 bytes} [Fri Jul 15 20:42:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:42:45.265694 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b1a6ba-782d-4dd3-ab93-7947981e99e0 None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:45.266344 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b1a6ba-782d-4dd3-ab93-7947981e99e0 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:45.266344 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b1a6ba-782d-4dd3-ab93-7947981e99e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:45.284379 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-e9b1a6ba-782d-4dd3-ab93-7947981e99e0 None None] MFA Rules not processed for user `913ad55c6c7b4c41ac22dd0a93ef656c`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:42:45.285503 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-e9b1a6ba-782d-4dd3-ab93-7947981e99e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:42:45.294442 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 515/1028] 10.222.0.16 () {58 vars in 1015 bytes} [Fri Jul 15 20:42:45 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:42:45.309023 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace8b01-7f3e-4bbd-aab2-2c45825f4962 None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:45.309309 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace8b01-7f3e-4bbd-aab2-2c45825f4962 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:45.309589 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace8b01-7f3e-4bbd-aab2-2c45825f4962 None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:45.310956 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 514/1029] 10.222.0.16 () {54 vars in 918 bytes} [Fri Jul 15 20:42:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:42:45.315609 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c9302c-455e-46a7-8904-482ab6d56f73 None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:45.315897 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c9302c-455e-46a7-8904-482ab6d56f73 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:45.316179 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c9302c-455e-46a7-8904-482ab6d56f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:45.334705 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-64c9302c-455e-46a7-8904-482ab6d56f73 None None] MFA Rules not processed for user `b3e5296637584004b1888453ab9056c4`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:42:45.335902 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-64c9302c-455e-46a7-8904-482ab6d56f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:42:45.344456 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 516/1030] 10.222.0.16 () {58 vars in 1015 bytes} [Fri Jul 15 20:42:45 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:42:48.053293 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a17db9c-de25-40bc-ab43-f958b6040a9c None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:48.053859 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a17db9c-de25-40bc-ab43-f958b6040a9c None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:48.053859 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a17db9c-de25-40bc-ab43-f958b6040a9c None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:48.055233 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 515/1031] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 20:42:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:42:48.061056 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd4f4d2-a66b-4880-b085-6908f6fcdea8 None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:48.061470 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd4f4d2-a66b-4880-b085-6908f6fcdea8 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:48.061614 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd4f4d2-a66b-4880-b085-6908f6fcdea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:48.079751 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-1bd4f4d2-a66b-4880-b085-6908f6fcdea8 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:42:48.080920 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-1bd4f4d2-a66b-4880-b085-6908f6fcdea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:42:48.088607 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 517/1032] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 20:42:48 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:42:48.131793 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a17db9c-de25-40bc-ab43-f958b6040a9c None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:42:48.148084 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a17db9c-de25-40bc-ab43-f958b6040a9c None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:42:48.152908 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59497605-5a19-4443-82da-f4225895bc07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e5296637584004b1888453ab9056c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:42:48.153543 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59497605-5a19-4443-82da-f4225895bc07 service nova] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:48.153830 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59497605-5a19-4443-82da-f4225895bc07 service nova] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:48.154205 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59497605-5a19-4443-82da-f4225895bc07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:48.162251 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59497605-5a19-4443-82da-f4225895bc07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:42:48.163779 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59497605-5a19-4443-82da-f4225895bc07 service nova] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:42:48.176006 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 516/1033] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:42:48 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:42:49.138521 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d75458-fe64-40a6-ac25-4ed7d7aa2b78 None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:49.139088 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d75458-fe64-40a6-ac25-4ed7d7aa2b78 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:49.139088 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d75458-fe64-40a6-ac25-4ed7d7aa2b78 None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:49.140427 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 518/1034] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 20:42:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 20:42:49.145431 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55050b-47cf-4a72-b01f-470286e7c248 None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:49.145856 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55050b-47cf-4a72-b01f-470286e7c248 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:49.146059 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55050b-47cf-4a72-b01f-470286e7c248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:49.164251 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-bd55050b-47cf-4a72-b01f-470286e7c248 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:42:49.165429 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-bd55050b-47cf-4a72-b01f-470286e7c248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:42:49.173014 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 517/1035] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 20:42:49 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:42:49.387593 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d75458-fe64-40a6-ac25-4ed7d7aa2b78 None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:42:49.400861 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d75458-fe64-40a6-ac25-4ed7d7aa2b78 None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:42:49.405754 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7cb2e9-4a7f-41ff-97ea-28abdfda5bc2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e5296637584004b1888453ab9056c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:42:49.406412 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7cb2e9-4a7f-41ff-97ea-28abdfda5bc2 service nova] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:49.406725 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7cb2e9-4a7f-41ff-97ea-28abdfda5bc2 service nova] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:49.407005 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7cb2e9-4a7f-41ff-97ea-28abdfda5bc2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:49.415050 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7cb2e9-4a7f-41ff-97ea-28abdfda5bc2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:42:49.416621 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7cb2e9-4a7f-41ff-97ea-28abdfda5bc2 service nova] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:42:49.425751 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 519/1036] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:42:49 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 20:42:50.330965 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de547899-6d2d-46f0-9824-42c0859df3e9 None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:50.331533 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de547899-6d2d-46f0-9824-42c0859df3e9 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:50.331533 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de547899-6d2d-46f0-9824-42c0859df3e9 None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:50.332857 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 518/1037] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 20:42:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:42:50.337744 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adcb663-4860-497c-a2f6-55d10266dcc0 None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:50.338226 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adcb663-4860-497c-a2f6-55d10266dcc0 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:50.338334 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adcb663-4860-497c-a2f6-55d10266dcc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:50.357672 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-0adcb663-4860-497c-a2f6-55d10266dcc0 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:42:50.358893 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-0adcb663-4860-497c-a2f6-55d10266dcc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:42:50.366617 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 520/1038] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 20:42:50 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:42:50.521140 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de547899-6d2d-46f0-9824-42c0859df3e9 None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:42:50.535701 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de547899-6d2d-46f0-9824-42c0859df3e9 None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:42:50.540669 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cc01df-924a-498d-aac9-53ffc40a997d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e5296637584004b1888453ab9056c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:42:50.541309 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc01df-924a-498d-aac9-53ffc40a997d service nova] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:50.541595 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc01df-924a-498d-aac9-53ffc40a997d service nova] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:50.541871 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc01df-924a-498d-aac9-53ffc40a997d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:50.549959 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cc01df-924a-498d-aac9-53ffc40a997d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:42:50.551578 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cc01df-924a-498d-aac9-53ffc40a997d service nova] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:42:50.560889 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 519/1039] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:42:50 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:42:51.433982 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8103aac-316c-4f2f-9765-6b216a10dd1e None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:51.434606 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8103aac-316c-4f2f-9765-6b216a10dd1e None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:51.434606 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8103aac-316c-4f2f-9765-6b216a10dd1e None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:51.435932 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 521/1040] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 20:42:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:42:51.440870 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e89827-d119-4967-8348-98196931e1b1 None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:51.441308 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e89827-d119-4967-8348-98196931e1b1 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:51.441432 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e89827-d119-4967-8348-98196931e1b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:51.459274 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-b2e89827-d119-4967-8348-98196931e1b1 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:42:51.460463 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-b2e89827-d119-4967-8348-98196931e1b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:42:51.468353 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 520/1041] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 20:42:51 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:42:51.623422 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8103aac-316c-4f2f-9765-6b216a10dd1e None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:42:51.636657 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8103aac-316c-4f2f-9765-6b216a10dd1e None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:42:51.641530 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a623ac4-ef7c-4161-8b05-19035a1b9c65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e5296637584004b1888453ab9056c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:42:51.642199 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a623ac4-ef7c-4161-8b05-19035a1b9c65 service nova] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:51.642492 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a623ac4-ef7c-4161-8b05-19035a1b9c65 service nova] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:51.642776 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a623ac4-ef7c-4161-8b05-19035a1b9c65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:51.650892 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a623ac4-ef7c-4161-8b05-19035a1b9c65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:42:51.652989 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a623ac4-ef7c-4161-8b05-19035a1b9c65 service nova] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:42:51.662489 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 522/1042] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:42:51 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:42:52.525797 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e305fc-e8e4-43b4-a6b3-daaecd999e58 None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:52.526347 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e305fc-e8e4-43b4-a6b3-daaecd999e58 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:52.526347 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e305fc-e8e4-43b4-a6b3-daaecd999e58 None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:52.527661 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 521/1043] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 20:42:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:42:52.532425 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c003e9-c1b7-42dd-ba79-e541dedbb53e None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:52.532848 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c003e9-c1b7-42dd-ba79-e541dedbb53e None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:52.533121 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c003e9-c1b7-42dd-ba79-e541dedbb53e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:52.551144 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-e5c003e9-c1b7-42dd-ba79-e541dedbb53e None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:42:52.552373 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-e5c003e9-c1b7-42dd-ba79-e541dedbb53e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:42:52.560690 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 523/1044] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 20:42:52 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:42:52.715151 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e305fc-e8e4-43b4-a6b3-daaecd999e58 None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:42:52.728863 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e305fc-e8e4-43b4-a6b3-daaecd999e58 None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:42:52.734212 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a3ee54-ac2d-4104-b1b5-f1a150637224 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e5296637584004b1888453ab9056c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:42:52.734878 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a3ee54-ac2d-4104-b1b5-f1a150637224 service nova] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:52.735158 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a3ee54-ac2d-4104-b1b5-f1a150637224 service nova] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:52.735451 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a3ee54-ac2d-4104-b1b5-f1a150637224 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:52.743333 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a3ee54-ac2d-4104-b1b5-f1a150637224 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:42:52.744899 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a3ee54-ac2d-4104-b1b5-f1a150637224 service nova] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:42:52.754731 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 522/1045] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:42:52 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:42:53.569363 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f55973d-2b69-4c86-ae1c-d7ab180449e5 None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:53.569886 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f55973d-2b69-4c86-ae1c-d7ab180449e5 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:53.570018 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f55973d-2b69-4c86-ae1c-d7ab180449e5 None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:53.571319 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 524/1046] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 20:42:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:42:53.576503 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b142ede-a119-4bcd-beb9-d4244285210a None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:53.576932 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b142ede-a119-4bcd-beb9-d4244285210a None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:53.577058 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b142ede-a119-4bcd-beb9-d4244285210a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:53.594438 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-2b142ede-a119-4bcd-beb9-d4244285210a None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:42:53.595640 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-2b142ede-a119-4bcd-beb9-d4244285210a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:42:53.603253 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 523/1047] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 20:42:53 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:42:53.757120 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f55973d-2b69-4c86-ae1c-d7ab180449e5 None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:42:53.770403 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f55973d-2b69-4c86-ae1c-d7ab180449e5 None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:42:53.775212 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a1e713-a906-4593-854a-07161d209b28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e5296637584004b1888453ab9056c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:42:53.775841 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a1e713-a906-4593-854a-07161d209b28 service nova] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:53.776127 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a1e713-a906-4593-854a-07161d209b28 service nova] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:53.776404 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a1e713-a906-4593-854a-07161d209b28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:53.784302 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a1e713-a906-4593-854a-07161d209b28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:42:53.786188 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a1e713-a906-4593-854a-07161d209b28 service nova] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:42:53.795819 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 525/1048] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:42:53 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:42:54.608763 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e04a361-9f87-429c-9777-b8567d9cd45b None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:54.609279 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e04a361-9f87-429c-9777-b8567d9cd45b None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:54.609410 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e04a361-9f87-429c-9777-b8567d9cd45b None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:54.610795 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 524/1049] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 20:42:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:42:54.615733 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a39a2a9-d87f-4d29-82d1-c11a28250404 None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:54.616156 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a39a2a9-d87f-4d29-82d1-c11a28250404 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:54.616294 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a39a2a9-d87f-4d29-82d1-c11a28250404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:54.635744 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-9a39a2a9-d87f-4d29-82d1-c11a28250404 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:42:54.637592 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-9a39a2a9-d87f-4d29-82d1-c11a28250404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:42:54.645306 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 526/1050] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 20:42:54 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:42:54.799891 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e04a361-9f87-429c-9777-b8567d9cd45b None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:42:54.813462 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e04a361-9f87-429c-9777-b8567d9cd45b None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:42:54.818304 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0509fdd1-3546-4bc4-be46-790100b94321 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e5296637584004b1888453ab9056c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:42:54.818934 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509fdd1-3546-4bc4-be46-790100b94321 service nova] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:54.819217 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509fdd1-3546-4bc4-be46-790100b94321 service nova] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:54.819494 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509fdd1-3546-4bc4-be46-790100b94321 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:54.828196 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0509fdd1-3546-4bc4-be46-790100b94321 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:42:54.829763 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0509fdd1-3546-4bc4-be46-790100b94321 service nova] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:42:54.838996 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 525/1051] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:42:54 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:42:55.651297 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1bb1a3-4476-46b2-a587-3fcc15bd2fa4 None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:55.651811 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1bb1a3-4476-46b2-a587-3fcc15bd2fa4 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:55.651811 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1bb1a3-4476-46b2-a587-3fcc15bd2fa4 None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:55.653159 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 527/1052] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 20:42:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:42:55.658156 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54437c09-79c6-4d18-bf11-2fd2c7afd4be None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:55.658534 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54437c09-79c6-4d18-bf11-2fd2c7afd4be None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:55.658718 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54437c09-79c6-4d18-bf11-2fd2c7afd4be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:55.676096 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-54437c09-79c6-4d18-bf11-2fd2c7afd4be None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:42:55.677288 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-54437c09-79c6-4d18-bf11-2fd2c7afd4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:42:55.685545 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 526/1053] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 20:42:55 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 20:42:55.843171 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1bb1a3-4476-46b2-a587-3fcc15bd2fa4 None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:42:55.856783 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1bb1a3-4476-46b2-a587-3fcc15bd2fa4 None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:42:55.861602 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114e2f5d-936a-4489-8452-9fcd9c9a9ab5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e5296637584004b1888453ab9056c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:42:55.862254 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e2f5d-936a-4489-8452-9fcd9c9a9ab5 service nova] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:55.862536 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e2f5d-936a-4489-8452-9fcd9c9a9ab5 service nova] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:55.862808 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e2f5d-936a-4489-8452-9fcd9c9a9ab5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:55.871540 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114e2f5d-936a-4489-8452-9fcd9c9a9ab5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:42:55.873097 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114e2f5d-936a-4489-8452-9fcd9c9a9ab5 service nova] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:42:55.882205 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 528/1054] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:42:55 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:42:56.691189 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f501d-6061-4c32-9c1b-a9cf697b9b4f None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:56.691758 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f501d-6061-4c32-9c1b-a9cf697b9b4f None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:56.691758 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f501d-6061-4c32-9c1b-a9cf697b9b4f None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:56.693078 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 527/1055] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 20:42:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:42:56.698353 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c283d526-27b0-4d7f-b4df-51a3ac37f861 None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:56.698799 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c283d526-27b0-4d7f-b4df-51a3ac37f861 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:56.698902 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c283d526-27b0-4d7f-b4df-51a3ac37f861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:56.716470 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-c283d526-27b0-4d7f-b4df-51a3ac37f861 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:42:56.717671 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-c283d526-27b0-4d7f-b4df-51a3ac37f861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:42:56.725385 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 529/1056] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 20:42:56 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:42:56.879427 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f501d-6061-4c32-9c1b-a9cf697b9b4f None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:42:56.892503 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f501d-6061-4c32-9c1b-a9cf697b9b4f None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:42:56.897315 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4be8b6-9fa1-4c7c-8b23-2e4f6302f8c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e5296637584004b1888453ab9056c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:42:56.897945 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4be8b6-9fa1-4c7c-8b23-2e4f6302f8c5 service nova] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:56.898266 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4be8b6-9fa1-4c7c-8b23-2e4f6302f8c5 service nova] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:56.898547 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4be8b6-9fa1-4c7c-8b23-2e4f6302f8c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:56.907013 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4be8b6-9fa1-4c7c-8b23-2e4f6302f8c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:42:56.908607 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4be8b6-9fa1-4c7c-8b23-2e4f6302f8c5 service nova] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:42:56.918357 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 528/1057] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:42:56 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:42:59.016479 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866df2ca-2551-420c-9d52-e8efd05ad631 None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:59.017018 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866df2ca-2551-420c-9d52-e8efd05ad631 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:59.017018 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866df2ca-2551-420c-9d52-e8efd05ad631 None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:59.018722 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 530/1058] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 20:42:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:42:59.023930 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a1aad2-ba14-4676-b20a-b665921fb3a1 None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:59.024357 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a1aad2-ba14-4676-b20a-b665921fb3a1 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:59.024491 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a1aad2-ba14-4676-b20a-b665921fb3a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:59.042616 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-b5a1aad2-ba14-4676-b20a-b665921fb3a1 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:42:59.043819 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-b5a1aad2-ba14-4676-b20a-b665921fb3a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:42:59.051555 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 529/1059] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 20:42:59 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:42:59.093242 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866df2ca-2551-420c-9d52-e8efd05ad631 None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:42:59.103691 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866df2ca-2551-420c-9d52-e8efd05ad631 None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:42:59.107147 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f35eab6-206c-491b-b24b-f25d0b55432d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3491680e892041678242f9b93617b9a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:42:59.107777 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35eab6-206c-491b-b24b-f25d0b55432d service neutron] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:59.108063 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35eab6-206c-491b-b24b-f25d0b55432d service neutron] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:59.108338 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35eab6-206c-491b-b24b-f25d0b55432d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:59.116997 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f35eab6-206c-491b-b24b-f25d0b55432d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:42:59.118459 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f35eab6-206c-491b-b24b-f25d0b55432d service neutron] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:42:59.128284 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 531/1060] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:42:59 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:43:01.563085 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e4bfc-f7d4-409e-80b0-a8ae753da919 None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:01.563635 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e4bfc-f7d4-409e-80b0-a8ae753da919 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:01.563635 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e4bfc-f7d4-409e-80b0-a8ae753da919 None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:01.565033 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 530/1061] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 20:43:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:43:01.570229 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c5599-dfb1-4560-bf3f-ca179efe3d69 None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:01.570607 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c5599-dfb1-4560-bf3f-ca179efe3d69 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:01.570782 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c5599-dfb1-4560-bf3f-ca179efe3d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:01.588219 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-f47c5599-dfb1-4560-bf3f-ca179efe3d69 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:43:01.589391 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-f47c5599-dfb1-4560-bf3f-ca179efe3d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:43:01.597652 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 532/1062] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 20:43:01 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:43:01.636139 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73e4bfc-f7d4-409e-80b0-a8ae753da919 None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:43:01.646770 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73e4bfc-f7d4-409e-80b0-a8ae753da919 None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:43:01.650248 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94640f1d-ec30-4971-b9d5-5c656b4a9434 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3491680e892041678242f9b93617b9a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:43:01.650884 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94640f1d-ec30-4971-b9d5-5c656b4a9434 service neutron] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:01.651172 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94640f1d-ec30-4971-b9d5-5c656b4a9434 service neutron] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:01.651453 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94640f1d-ec30-4971-b9d5-5c656b4a9434 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:01.660732 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94640f1d-ec30-4971-b9d5-5c656b4a9434 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:43:01.662197 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94640f1d-ec30-4971-b9d5-5c656b4a9434 service neutron] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:43:01.672040 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 531/1063] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:43:01 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:43:04.220840 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeb7316-4f39-4e0c-bdef-3b299a421690 None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:04.221369 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeb7316-4f39-4e0c-bdef-3b299a421690 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:04.221463 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeb7316-4f39-4e0c-bdef-3b299a421690 None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:04.222787 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 533/1064] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 20:43:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:43:04.227933 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f73fa7-d36a-4543-a8d2-081ebf040163 None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:04.228314 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f73fa7-d36a-4543-a8d2-081ebf040163 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:04.228493 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f73fa7-d36a-4543-a8d2-081ebf040163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:04.245634 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-26f73fa7-d36a-4543-a8d2-081ebf040163 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:43:04.246871 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-26f73fa7-d36a-4543-a8d2-081ebf040163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:43:04.254549 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 532/1065] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 20:43:04 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:43:04.295881 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeb7316-4f39-4e0c-bdef-3b299a421690 None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:43:04.306746 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeb7316-4f39-4e0c-bdef-3b299a421690 None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:43:04.310892 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e5356c-a1ff-4e9b-8a4b-da47922e5925 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3491680e892041678242f9b93617b9a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:43:04.311534 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e5356c-a1ff-4e9b-8a4b-da47922e5925 service neutron] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:04.311823 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e5356c-a1ff-4e9b-8a4b-da47922e5925 service neutron] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:04.312104 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e5356c-a1ff-4e9b-8a4b-da47922e5925 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:04.321128 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e5356c-a1ff-4e9b-8a4b-da47922e5925 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:43:04.322626 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e5356c-a1ff-4e9b-8a4b-da47922e5925 service neutron] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:43:04.332826 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 534/1066] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:43:04 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:43:06.673079 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1471405-639a-4136-b0ac-805c461b5a86 None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:06.673605 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1471405-639a-4136-b0ac-805c461b5a86 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:06.673699 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1471405-639a-4136-b0ac-805c461b5a86 None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:06.675005 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 533/1067] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 20:43:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:43:06.680171 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad71fe-c4a0-4a27-9336-49fdafa01f9e None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:06.680618 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad71fe-c4a0-4a27-9336-49fdafa01f9e None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:06.680722 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad71fe-c4a0-4a27-9336-49fdafa01f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:06.698306 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-6cad71fe-c4a0-4a27-9336-49fdafa01f9e None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:43:06.699641 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-6cad71fe-c4a0-4a27-9336-49fdafa01f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:43:06.707301 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 535/1068] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 20:43:06 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:43:06.747497 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1471405-639a-4136-b0ac-805c461b5a86 None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:43:06.758097 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1471405-639a-4136-b0ac-805c461b5a86 None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:43:06.761515 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe265e3-bc81-441a-932a-81303c1308f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3491680e892041678242f9b93617b9a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:43:06.762208 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe265e3-bc81-441a-932a-81303c1308f6 service neutron] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:06.762494 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe265e3-bc81-441a-932a-81303c1308f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:06.762772 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe265e3-bc81-441a-932a-81303c1308f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:06.771496 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe265e3-bc81-441a-932a-81303c1308f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:43:06.772928 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe265e3-bc81-441a-932a-81303c1308f6 service neutron] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:43:06.782625 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 534/1069] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:43:06 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:43:09.052085 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca464e0-20c8-4364-bddb-268738e86ee1 None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:09.052698 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca464e0-20c8-4364-bddb-268738e86ee1 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:09.052698 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca464e0-20c8-4364-bddb-268738e86ee1 None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:09.054005 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 536/1070] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 20:43:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:43:09.060498 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abafb267-6cab-46c7-8134-93f4ab7656db None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:09.060909 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abafb267-6cab-46c7-8134-93f4ab7656db None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:09.061056 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abafb267-6cab-46c7-8134-93f4ab7656db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:09.079069 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-abafb267-6cab-46c7-8134-93f4ab7656db None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:43:09.080255 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-abafb267-6cab-46c7-8134-93f4ab7656db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:43:09.088523 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 535/1071] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 20:43:09 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:43:09.127203 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca464e0-20c8-4364-bddb-268738e86ee1 None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:43:09.138815 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca464e0-20c8-4364-bddb-268738e86ee1 None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:43:09.142653 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85542a16-1efc-43ff-be05-3dc1a5ff76c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3491680e892041678242f9b93617b9a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:43:09.143292 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85542a16-1efc-43ff-be05-3dc1a5ff76c6 service neutron] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:09.143581 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85542a16-1efc-43ff-be05-3dc1a5ff76c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:09.143862 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85542a16-1efc-43ff-be05-3dc1a5ff76c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:09.152953 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85542a16-1efc-43ff-be05-3dc1a5ff76c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:43:09.154424 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85542a16-1efc-43ff-be05-3dc1a5ff76c6 service neutron] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:43:09.164021 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 537/1072] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:43:09 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:43:11.422038 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb61036-bcbb-43ff-be1a-54ea1ccc8b78 None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:11.422568 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb61036-bcbb-43ff-be1a-54ea1ccc8b78 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:11.422568 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb61036-bcbb-43ff-be1a-54ea1ccc8b78 None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:11.423883 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 536/1073] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 20:43:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:43:11.429142 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5674595-029f-47c1-aee0-f439cbbfbe7a None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:11.429545 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5674595-029f-47c1-aee0-f439cbbfbe7a None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:11.429779 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5674595-029f-47c1-aee0-f439cbbfbe7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:11.447649 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-a5674595-029f-47c1-aee0-f439cbbfbe7a None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:43:11.449188 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-a5674595-029f-47c1-aee0-f439cbbfbe7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:43:11.459282 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 538/1074] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 20:43:11 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:43:11.498170 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb61036-bcbb-43ff-be1a-54ea1ccc8b78 None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:43:11.508721 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb61036-bcbb-43ff-be1a-54ea1ccc8b78 None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:43:11.512647 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9460df2-2b55-4072-8ae6-7c3ba504edf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3491680e892041678242f9b93617b9a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:43:11.513276 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9460df2-2b55-4072-8ae6-7c3ba504edf9 service neutron] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:11.513560 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9460df2-2b55-4072-8ae6-7c3ba504edf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:11.513833 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9460df2-2b55-4072-8ae6-7c3ba504edf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:11.522514 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9460df2-2b55-4072-8ae6-7c3ba504edf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:43:11.524042 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9460df2-2b55-4072-8ae6-7c3ba504edf9 service neutron] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:43:11.533869 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 537/1075] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:43:11 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:43:13.817148 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85082269-4dc2-4dd7-bd87-beba7d274a6b None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:13.817656 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85082269-4dc2-4dd7-bd87-beba7d274a6b None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:13.817753 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85082269-4dc2-4dd7-bd87-beba7d274a6b None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:13.819189 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 539/1076] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 20:43:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:43:13.825215 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d854ca78-69ec-4bf9-aa4c-99e7d7a0ccf2 None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:13.825618 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d854ca78-69ec-4bf9-aa4c-99e7d7a0ccf2 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:13.825775 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d854ca78-69ec-4bf9-aa4c-99e7d7a0ccf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:13.831751 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=70 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:43:13.844794 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-d854ca78-69ec-4bf9-aa4c-99e7d7a0ccf2 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:43:13.845989 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-d854ca78-69ec-4bf9-aa4c-99e7d7a0ccf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:43:13.853695 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 538/1077] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 20:43:13 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:43:13.893109 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85082269-4dc2-4dd7-bd87-beba7d274a6b None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:43:13.898431 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=73 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:43:13.905491 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85082269-4dc2-4dd7-bd87-beba7d274a6b None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:43:13.908916 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992fe7f1-6bf6-46c0-83c3-3f334da83b7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3491680e892041678242f9b93617b9a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:43:13.909570 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992fe7f1-6bf6-46c0-83c3-3f334da83b7e service neutron] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:13.909854 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992fe7f1-6bf6-46c0-83c3-3f334da83b7e service neutron] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:13.910166 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992fe7f1-6bf6-46c0-83c3-3f334da83b7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:13.918952 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992fe7f1-6bf6-46c0-83c3-3f334da83b7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:43:13.920360 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992fe7f1-6bf6-46c0-83c3-3f334da83b7e service neutron] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:43:13.929556 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 540/1078] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:43:13 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:43:16.193925 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c7a7db-d15b-4ea0-bc29-1926c2ed8bc4 None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:16.194524 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c7a7db-d15b-4ea0-bc29-1926c2ed8bc4 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:16.194524 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c7a7db-d15b-4ea0-bc29-1926c2ed8bc4 None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:16.195784 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 539/1079] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 20:43:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:43:16.201717 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df7c48f-6fde-4813-95cf-62fe0b15cd3a None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:16.202192 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df7c48f-6fde-4813-95cf-62fe0b15cd3a None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:16.202294 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df7c48f-6fde-4813-95cf-62fe0b15cd3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:16.220495 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-4df7c48f-6fde-4813-95cf-62fe0b15cd3a None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:43:16.221679 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-4df7c48f-6fde-4813-95cf-62fe0b15cd3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:43:16.229510 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 541/1080] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 20:43:16 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:43:16.267631 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c7a7db-d15b-4ea0-bc29-1926c2ed8bc4 None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:43:16.278711 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c7a7db-d15b-4ea0-bc29-1926c2ed8bc4 None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:43:16.282169 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b4a025-7f51-49bb-94a4-f4d1b3a80789 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3491680e892041678242f9b93617b9a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:43:16.282808 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4a025-7f51-49bb-94a4-f4d1b3a80789 service neutron] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:16.283096 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4a025-7f51-49bb-94a4-f4d1b3a80789 service neutron] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:16.283378 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4a025-7f51-49bb-94a4-f4d1b3a80789 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:16.292082 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b4a025-7f51-49bb-94a4-f4d1b3a80789 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:43:16.293517 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b4a025-7f51-49bb-94a4-f4d1b3a80789 service neutron] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:43:16.302710 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 540/1081] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:43:16 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:43:18.570232 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7269ac52-208b-4b91-867c-2940cc05a7d7 None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:18.570810 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7269ac52-208b-4b91-867c-2940cc05a7d7 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:18.570810 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7269ac52-208b-4b91-867c-2940cc05a7d7 None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:18.572166 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 542/1082] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 20:43:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:43:18.578098 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae8fbef-fece-4b6f-8d48-6fae0e8a1acf None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:18.578522 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae8fbef-fece-4b6f-8d48-6fae0e8a1acf None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:18.578674 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae8fbef-fece-4b6f-8d48-6fae0e8a1acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:18.595864 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-0ae8fbef-fece-4b6f-8d48-6fae0e8a1acf None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:43:18.597053 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-0ae8fbef-fece-4b6f-8d48-6fae0e8a1acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:43:18.604729 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 541/1083] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 20:43:18 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:43:18.643326 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7269ac52-208b-4b91-867c-2940cc05a7d7 None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:43:18.653840 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7269ac52-208b-4b91-867c-2940cc05a7d7 None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:43:18.657292 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d2c51b-1859-4c66-8e57-4b874b5981a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3491680e892041678242f9b93617b9a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:43:18.657915 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d2c51b-1859-4c66-8e57-4b874b5981a7 service neutron] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:18.658226 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d2c51b-1859-4c66-8e57-4b874b5981a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:18.658500 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d2c51b-1859-4c66-8e57-4b874b5981a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:18.667098 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d2c51b-1859-4c66-8e57-4b874b5981a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:43:18.668509 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d2c51b-1859-4c66-8e57-4b874b5981a7 service neutron] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:43:18.677511 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 543/1084] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:43:18 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:43:20.955370 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec063a-d1c3-44c1-96f0-be42bc748469 None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:20.955913 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec063a-d1c3-44c1-96f0-be42bc748469 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:20.955913 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec063a-d1c3-44c1-96f0-be42bc748469 None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:20.957276 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 542/1085] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 20:43:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:43:20.962580 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93f2e6-33a8-4bad-b927-70303c603eb7 None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:20.963010 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93f2e6-33a8-4bad-b927-70303c603eb7 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:20.963119 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93f2e6-33a8-4bad-b927-70303c603eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:20.981519 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-4a93f2e6-33a8-4bad-b927-70303c603eb7 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:43:20.982733 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-4a93f2e6-33a8-4bad-b927-70303c603eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:43:20.990310 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 544/1086] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 20:43:20 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:43:21.027781 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec063a-d1c3-44c1-96f0-be42bc748469 None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:43:21.038251 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec063a-d1c3-44c1-96f0-be42bc748469 None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:43:21.041630 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15db88f2-dd0f-4690-98b9-f3d16a7f118a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3491680e892041678242f9b93617b9a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:43:21.042298 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db88f2-dd0f-4690-98b9-f3d16a7f118a service neutron] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:21.042589 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db88f2-dd0f-4690-98b9-f3d16a7f118a service neutron] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:21.043474 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db88f2-dd0f-4690-98b9-f3d16a7f118a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:21.052299 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15db88f2-dd0f-4690-98b9-f3d16a7f118a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:43:21.053783 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15db88f2-dd0f-4690-98b9-f3d16a7f118a service neutron] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:43:21.063246 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 543/1087] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:43:21 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:43:30.976016 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=17 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:43:31.059279 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=17 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:43:44.632690 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01125207-3b15-4458-9fa1-18f2ade0723c None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:44.633247 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01125207-3b15-4458-9fa1-18f2ade0723c None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:44.633247 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01125207-3b15-4458-9fa1-18f2ade0723c None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:44.634635 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 545/1088] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:43:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:43:44.639741 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf25ada-2169-459a-9590-1a1dc74c0315 None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:44.640182 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf25ada-2169-459a-9590-1a1dc74c0315 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:44.640307 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf25ada-2169-459a-9590-1a1dc74c0315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:44.657580 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-3cf25ada-2169-459a-9590-1a1dc74c0315 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:43:44.658801 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-3cf25ada-2169-459a-9590-1a1dc74c0315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:43:44.666465 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 544/1089] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:43:44 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:43:44.717601 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc3a06-643d-40ba-ba1c-6107d758a924 None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:44.717898 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc3a06-643d-40ba-ba1c-6107d758a924 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:44.718219 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc3a06-643d-40ba-ba1c-6107d758a924 None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:44.719572 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 546/1090] 10.222.0.16 () {54 vars in 960 bytes} [Fri Jul 15 20:43:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:43:44.725250 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec50f2-37ba-4d28-b7f1-e7040dc8da3c None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:44.725538 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec50f2-37ba-4d28-b7f1-e7040dc8da3c None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:44.725820 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec50f2-37ba-4d28-b7f1-e7040dc8da3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:44.744397 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-e6ec50f2-37ba-4d28-b7f1-e7040dc8da3c None None] MFA Rules not processed for user `2766cf20921045a896ff7735cc2534d6`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:43:44.746174 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-e6ec50f2-37ba-4d28-b7f1-e7040dc8da3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:43:44.752918 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 545/1091] 10.222.0.16 () {58 vars in 1057 bytes} [Fri Jul 15 20:43:44 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:43:44.760239 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bc3a06-643d-40ba-ba1c-6107d758a924 None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:43:44.771587 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bc3a06-643d-40ba-ba1c-6107d758a924 None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:43:44.775112 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75637b6d-64f4-41d8-bd0d-9fb8b9c8b8d5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2766cf20921045a896ff7735cc2534d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:43:44.775873 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75637b6d-64f4-41d8-bd0d-9fb8b9c8b8d5 service glance] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:44.776170 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75637b6d-64f4-41d8-bd0d-9fb8b9c8b8d5 service glance] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:44.776454 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75637b6d-64f4-41d8-bd0d-9fb8b9c8b8d5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:44.786360 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75637b6d-64f4-41d8-bd0d-9fb8b9c8b8d5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:43:44.787793 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75637b6d-64f4-41d8-bd0d-9fb8b9c8b8d5 service glance] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:43:44.798018 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 547/1092] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:43:44 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:43:47.124256 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae05613-2210-4df1-80d8-eca774ab0910 None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:47.124870 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae05613-2210-4df1-80d8-eca774ab0910 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:47.124870 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae05613-2210-4df1-80d8-eca774ab0910 None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:47.126195 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 546/1093] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:43:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:43:47.131399 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f58c2-7159-482c-b4ac-59f4635d9fb6 None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:47.131797 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f58c2-7159-482c-b4ac-59f4635d9fb6 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:47.131966 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f58c2-7159-482c-b4ac-59f4635d9fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:47.149621 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-0c7f58c2-7159-482c-b4ac-59f4635d9fb6 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:43:47.150851 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-0c7f58c2-7159-482c-b4ac-59f4635d9fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:43:47.158981 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 548/1094] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:43:47 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:43:47.183264 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae05613-2210-4df1-80d8-eca774ab0910 None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:43:47.195660 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae05613-2210-4df1-80d8-eca774ab0910 None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:43:47.200461 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cb018d-935c-4dad-b6f7-b1be8ecf4363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5e0cb75b5f34491a7e94518c7bcdb03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:43:47.201100 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb018d-935c-4dad-b6f7-b1be8ecf4363 admin admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:47.201386 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb018d-935c-4dad-b6f7-b1be8ecf4363 admin admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:47.201661 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb018d-935c-4dad-b6f7-b1be8ecf4363 admin admin] PATH_INFO: `/v3/projects` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:47.202426 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cb018d-935c-4dad-b6f7-b1be8ecf4363 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:43:47.204164 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: WARNING py.warnings [None req-b5cb018d-935c-4dad-b6f7-b1be8ecf4363 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 20:43:47.204164 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: warnings.warn(msg) Jul 15 20:43:47.204164 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: Jul 15 20:43:47.205298 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cb018d-935c-4dad-b6f7-b1be8ecf4363 admin admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:43:47.223891 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 547/1095] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jul 15 20:43:47 2022] GET /identity/v3/projects => generated 1606 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:43:49.466890 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8821805-9bef-4cfc-8589-51e2c12fffc9 None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:49.467446 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8821805-9bef-4cfc-8589-51e2c12fffc9 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:49.467446 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8821805-9bef-4cfc-8589-51e2c12fffc9 None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:49.468806 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 549/1096] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:43:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:43:49.474006 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db019aa1-26d6-4a6b-a812-0752c3c08d39 None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:49.474471 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db019aa1-26d6-4a6b-a812-0752c3c08d39 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:49.474656 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db019aa1-26d6-4a6b-a812-0752c3c08d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:49.491987 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-db019aa1-26d6-4a6b-a812-0752c3c08d39 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:43:49.493168 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-db019aa1-26d6-4a6b-a812-0752c3c08d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:43:49.501471 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 548/1097] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:43:49 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:43:49.545582 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8821805-9bef-4cfc-8589-51e2c12fffc9 None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:43:49.559406 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8821805-9bef-4cfc-8589-51e2c12fffc9 None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:43:49.564354 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49531fc-78e6-4a66-8649-6cb310a5a23a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e5296637584004b1888453ab9056c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:43:49.564985 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49531fc-78e6-4a66-8649-6cb310a5a23a service nova] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:49.565270 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49531fc-78e6-4a66-8649-6cb310a5a23a service nova] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:49.565550 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49531fc-78e6-4a66-8649-6cb310a5a23a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:49.574416 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49531fc-78e6-4a66-8649-6cb310a5a23a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:43:49.575986 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49531fc-78e6-4a66-8649-6cb310a5a23a service nova] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:43:49.585225 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 550/1098] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:43:49 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:43:51.972635 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5960bd0-a2c5-4270-867f-3d7a57c334f6 None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:51.973083 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5960bd0-a2c5-4270-867f-3d7a57c334f6 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:51.973189 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5960bd0-a2c5-4270-867f-3d7a57c334f6 None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:51.974593 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 549/1099] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:43:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:43:51.979862 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41139071-858a-42c6-9082-031cbb94f104 None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:51.980276 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41139071-858a-42c6-9082-031cbb94f104 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:51.980419 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41139071-858a-42c6-9082-031cbb94f104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:51.997666 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-41139071-858a-42c6-9082-031cbb94f104 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:43:51.998868 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-41139071-858a-42c6-9082-031cbb94f104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:43:52.006455 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 551/1100] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:43:51 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:43:52.043664 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5960bd0-a2c5-4270-867f-3d7a57c334f6 None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:43:52.054199 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5960bd0-a2c5-4270-867f-3d7a57c334f6 None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:43:52.057657 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb033fd-6c45-46d7-85e6-884f3ab7c2a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3491680e892041678242f9b93617b9a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:43:52.058343 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb033fd-6c45-46d7-85e6-884f3ab7c2a4 service neutron] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:52.058633 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb033fd-6c45-46d7-85e6-884f3ab7c2a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:52.058920 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb033fd-6c45-46d7-85e6-884f3ab7c2a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:52.067681 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb033fd-6c45-46d7-85e6-884f3ab7c2a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:43:52.069419 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb033fd-6c45-46d7-85e6-884f3ab7c2a4 service neutron] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:43:52.079553 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 550/1101] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:43:52 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:43:54.359318 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7bb8d2-9141-440b-8303-26241d8da0e3 None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:54.359870 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7bb8d2-9141-440b-8303-26241d8da0e3 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:54.359870 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7bb8d2-9141-440b-8303-26241d8da0e3 None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:54.361257 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 552/1102] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:43:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:43:54.366495 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20c256-48f3-4078-97b4-f5c1516e7282 None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:54.366919 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20c256-48f3-4078-97b4-f5c1516e7282 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:54.367056 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20c256-48f3-4078-97b4-f5c1516e7282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:54.384244 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-0e20c256-48f3-4078-97b4-f5c1516e7282 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:43:54.385433 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-0e20c256-48f3-4078-97b4-f5c1516e7282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:43:54.393922 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 551/1103] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:43:54 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:43:54.432733 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7bb8d2-9141-440b-8303-26241d8da0e3 None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:43:54.443417 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7bb8d2-9141-440b-8303-26241d8da0e3 None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:43:54.446928 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e17504-5c99-4631-acda-484871c190a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3491680e892041678242f9b93617b9a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:43:54.447561 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e17504-5c99-4631-acda-484871c190a0 service neutron] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:54.447852 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e17504-5c99-4631-acda-484871c190a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:54.448138 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e17504-5c99-4631-acda-484871c190a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:54.457999 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e17504-5c99-4631-acda-484871c190a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:43:54.459455 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e17504-5c99-4631-acda-484871c190a0 service neutron] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:43:54.469570 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 553/1104] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:43:54 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:43:56.845750 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743dbacd-5a88-4ffb-b69e-c4af4e7daf60 None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:56.846310 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743dbacd-5a88-4ffb-b69e-c4af4e7daf60 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:56.846310 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743dbacd-5a88-4ffb-b69e-c4af4e7daf60 None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:56.847590 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 552/1105] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:43:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:43:56.852865 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9937059-5b8a-434e-b082-ef66b202dc36 None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:56.853316 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9937059-5b8a-434e-b082-ef66b202dc36 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:56.853421 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9937059-5b8a-434e-b082-ef66b202dc36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:56.871359 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-c9937059-5b8a-434e-b082-ef66b202dc36 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:43:56.872544 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-c9937059-5b8a-434e-b082-ef66b202dc36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:43:56.880149 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 554/1106] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:43:56 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:43:56.921116 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743dbacd-5a88-4ffb-b69e-c4af4e7daf60 None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:43:56.934193 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743dbacd-5a88-4ffb-b69e-c4af4e7daf60 None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:43:56.937643 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff58df40-a051-487a-988a-fd04013da146 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3491680e892041678242f9b93617b9a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:43:56.938313 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff58df40-a051-487a-988a-fd04013da146 service neutron] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:56.938601 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff58df40-a051-487a-988a-fd04013da146 service neutron] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:56.938879 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff58df40-a051-487a-988a-fd04013da146 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:56.947635 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff58df40-a051-487a-988a-fd04013da146 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:43:56.949972 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff58df40-a051-487a-988a-fd04013da146 service neutron] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:43:56.959585 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 553/1107] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:43:56 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 20:43:59.401395 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17faa4c4-c956-497d-8a7c-cc7d47ea99ce None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:59.401955 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17faa4c4-c956-497d-8a7c-cc7d47ea99ce None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:59.401955 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17faa4c4-c956-497d-8a7c-cc7d47ea99ce None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:59.403394 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 555/1108] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jul 15 20:43:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:43:59.408492 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b503627-aecb-4df6-b3c6-d14491ec692f None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:59.408868 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b503627-aecb-4df6-b3c6-d14491ec692f None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:59.409063 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b503627-aecb-4df6-b3c6-d14491ec692f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:59.426857 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-2b503627-aecb-4df6-b3c6-d14491ec692f None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:43:59.428057 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-2b503627-aecb-4df6-b3c6-d14491ec692f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:43:59.436366 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 554/1109] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jul 15 20:43:59 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:43:59.475650 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17faa4c4-c956-497d-8a7c-cc7d47ea99ce None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:43:59.486692 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17faa4c4-c956-497d-8a7c-cc7d47ea99ce None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:43:59.490144 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3819a4bf-7173-4109-9b99-fa87cd3f4a7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3491680e892041678242f9b93617b9a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:43:59.490776 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3819a4bf-7173-4109-9b99-fa87cd3f4a7a service neutron] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:59.491056 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3819a4bf-7173-4109-9b99-fa87cd3f4a7a service neutron] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:59.491330 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3819a4bf-7173-4109-9b99-fa87cd3f4a7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:59.500602 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3819a4bf-7173-4109-9b99-fa87cd3f4a7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:43:59.502018 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3819a4bf-7173-4109-9b99-fa87cd3f4a7a service neutron] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:43:59.511185 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 556/1110] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:43:59 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:44:09.421907 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=33 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:44:09.507143 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=33 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:45:30.870491 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dbc89a-9b4d-42da-acde-02d5d29395ab None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:45:30.871072 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dbc89a-9b4d-42da-acde-02d5d29395ab None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:45:30.871072 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dbc89a-9b4d-42da-acde-02d5d29395ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:45:30.891003 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-44dbc89a-9b4d-42da-acde-02d5d29395ab None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:45:30.895516 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-44dbc89a-9b4d-42da-acde-02d5d29395ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:45:30.903546 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 555/1111] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jul 15 20:45:30 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:45:30.911511 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ea1da-5757-459c-97f6-c4097ff81f5c None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:45:30.912005 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ea1da-5757-459c-97f6-c4097ff81f5c None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:45:30.912103 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ea1da-5757-459c-97f6-c4097ff81f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:45:30.930017 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-6b1ea1da-5757-459c-97f6-c4097ff81f5c None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:45:30.931255 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-6b1ea1da-5757-459c-97f6-c4097ff81f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:45:30.939631 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 557/1112] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jul 15 20:45:30 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:45:30.943901 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dbc89a-9b4d-42da-acde-02d5d29395ab None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:45:30.953672 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dbc89a-9b4d-42da-acde-02d5d29395ab None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:45:30.958430 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b28f0e-3d96-4ba5-aa7f-9bc5e28f7933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5e0cb75b5f34491a7e94518c7bcdb03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:45:30.959099 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b28f0e-3d96-4ba5-aa7f-9bc5e28f7933 admin admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:45:30.959396 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b28f0e-3d96-4ba5-aa7f-9bc5e28f7933 admin admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:45:30.959674 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b28f0e-3d96-4ba5-aa7f-9bc5e28f7933 admin admin] PATH_INFO: `/v3/domains` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:45:30.960389 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b28f0e-3d96-4ba5-aa7f-9bc5e28f7933 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98952) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:45:30.960697 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b28f0e-3d96-4ba5-aa7f-9bc5e28f7933 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:45:30.961730 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: WARNING py.warnings [None req-43b28f0e-3d96-4ba5-aa7f-9bc5e28f7933 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 15 20:45:30.961730 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: warnings.warn(msg) Jul 15 20:45:30.961730 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: Jul 15 20:45:30.962693 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b28f0e-3d96-4ba5-aa7f-9bc5e28f7933 admin admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:45:30.974094 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 556/1113] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jul 15 20:45:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:45:30.982581 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1ea1da-5757-459c-97f6-c4097ff81f5c None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:45:30.991638 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1ea1da-5757-459c-97f6-c4097ff81f5c None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:45:30.997065 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392b17c8-4f45-49bf-900b-63fc537bc4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5e0cb75b5f34491a7e94518c7bcdb03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:45:30.997714 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b17c8-4f45-49bf-900b-63fc537bc4d2 admin admin] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:45:30.998022 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b17c8-4f45-49bf-900b-63fc537bc4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:45:30.998356 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b17c8-4f45-49bf-900b-63fc537bc4d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:45:30.999036 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392b17c8-4f45-49bf-900b-63fc537bc4d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:45:31.000836 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: WARNING py.warnings [None req-392b17c8-4f45-49bf-900b-63fc537bc4d2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 20:45:31.000836 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: warnings.warn(msg) Jul 15 20:45:31.000836 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: Jul 15 20:45:31.002161 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392b17c8-4f45-49bf-900b-63fc537bc4d2 admin admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:45:31.026960 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 558/1114] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jul 15 20:45:30 2022] POST /identity/v3/projects => generated 379 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:45:31.031015 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b28f0e-3d96-4ba5-aa7f-9bc5e28f7933 admin admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:45:31.040864 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b28f0e-3d96-4ba5-aa7f-9bc5e28f7933 admin admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:45:31.096086 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bef682a-d69a-40b4-ba2a-a6decd732f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5e0cb75b5f34491a7e94518c7bcdb03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:45:31.096751 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bef682a-d69a-40b4-ba2a-a6decd732f07 admin admin] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:45:31.097039 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bef682a-d69a-40b4-ba2a-a6decd732f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:45:31.097320 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bef682a-d69a-40b4-ba2a-a6decd732f07 admin admin] PATH_INFO: `/v3/users` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:45:31.098007 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bef682a-d69a-40b4-ba2a-a6decd732f07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:45:31.099113 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: WARNING py.warnings [None req-3bef682a-d69a-40b4-ba2a-a6decd732f07 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 20:45:31.099113 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: warnings.warn(msg) Jul 15 20:45:31.099113 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: Jul 15 20:45:31.100329 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bef682a-d69a-40b4-ba2a-a6decd732f07 admin admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:45:31.120813 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 557/1115] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jul 15 20:45:31 2022] POST /identity/v3/users => generated 290 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:45:31.124897 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392b17c8-4f45-49bf-900b-63fc537bc4d2 admin admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:45:31.134985 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392b17c8-4f45-49bf-900b-63fc537bc4d2 admin admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:45:31.139554 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ff42e3-483e-4d93-bdab-d22f70e41c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5e0cb75b5f34491a7e94518c7bcdb03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:45:31.140206 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff42e3-483e-4d93-bdab-d22f70e41c36 admin admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:45:31.140495 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff42e3-483e-4d93-bdab-d22f70e41c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:45:31.140777 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff42e3-483e-4d93-bdab-d22f70e41c36 admin admin] PATH_INFO: `/v3/roles` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:45:31.141520 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ff42e3-483e-4d93-bdab-d22f70e41c36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:45:31.142558 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: WARNING py.warnings [None req-c7ff42e3-483e-4d93-bdab-d22f70e41c36 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 15 20:45:31.142558 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: warnings.warn(msg) Jul 15 20:45:31.142558 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: Jul 15 20:45:31.143454 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ff42e3-483e-4d93-bdab-d22f70e41c36 admin admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:45:31.157282 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 559/1116] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jul 15 20:45:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:45:31.161921 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bef682a-d69a-40b4-ba2a-a6decd732f07 admin admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:45:31.173054 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bef682a-d69a-40b4-ba2a-a6decd732f07 admin admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:45:31.178617 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3153b2-4168-4163-8095-559fa3958059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5e0cb75b5f34491a7e94518c7bcdb03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:45:31.179273 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3153b2-4168-4163-8095-559fa3958059 admin admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:45:31.179560 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3153b2-4168-4163-8095-559fa3958059 admin admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:45:31.179838 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3153b2-4168-4163-8095-559fa3958059 admin admin] PATH_INFO: `/v3/roles` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:45:31.180555 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3153b2-4168-4163-8095-559fa3958059 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:45:31.181555 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: WARNING py.warnings [None req-2e3153b2-4168-4163-8095-559fa3958059 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 15 20:45:31.181555 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: warnings.warn(msg) Jul 15 20:45:31.181555 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: Jul 15 20:45:31.183189 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3153b2-4168-4163-8095-559fa3958059 admin admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:45:31.196405 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 558/1117] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jul 15 20:45:31 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:45:31.200746 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ff42e3-483e-4d93-bdab-d22f70e41c36 admin admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:45:31.210609 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ff42e3-483e-4d93-bdab-d22f70e41c36 admin admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:45:31.215187 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3511d7f-ab03-47ab-b60c-b01e3dd72025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5e0cb75b5f34491a7e94518c7bcdb03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:45:31.216060 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3511d7f-ab03-47ab-b60c-b01e3dd72025 admin admin] REQUEST_METHOD: `PUT` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:45:31.216351 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3511d7f-ab03-47ab-b60c-b01e3dd72025 admin admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:45:31.216633 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3511d7f-ab03-47ab-b60c-b01e3dd72025 admin admin] PATH_INFO: `/v3/projects/37a9a709098d44e1aad681df13f5b8c4/users/43af85f4437546fbbf5ed0b3154fecbf/roles/478906d6337444e68ea74da908d9a24d` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:45:31.232275 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3511d7f-ab03-47ab-b60c-b01e3dd72025 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37a9a709098d44e1aad681df13f5b8c4, user_id=43af85f4437546fbbf5ed0b3154fecbf, role_id=478906d6337444e68ea74da908d9a24d)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:45:31.233299 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: WARNING py.warnings [None req-c3511d7f-ab03-47ab-b60c-b01e3dd72025 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 20:45:31.233299 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: warnings.warn(msg) Jul 15 20:45:31.233299 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: Jul 15 20:45:31.235279 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3511d7f-ab03-47ab-b60c-b01e3dd72025 admin admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:45:31.249065 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 560/1118] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jul 15 20:45:31 2022] PUT /identity/v3/projects/37a9a709098d44e1aad681df13f5b8c4/users/43af85f4437546fbbf5ed0b3154fecbf/roles/478906d6337444e68ea74da908d9a24d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:45:31.261662 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff49e2c3-5890-4d09-9614-d385e286cd87 None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:45:31.261958 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff49e2c3-5890-4d09-9614-d385e286cd87 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:45:31.262288 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff49e2c3-5890-4d09-9614-d385e286cd87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:45:31.288740 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-ff49e2c3-5890-4d09-9614-d385e286cd87 None None] MFA Rules not processed for user `43af85f4437546fbbf5ed0b3154fecbf`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:45:31.289937 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-ff49e2c3-5890-4d09-9614-d385e286cd87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:45:31.351687 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 559/1119] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jul 15 20:45:31 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:45:31.365591 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e6428-2e4c-4574-8e2a-379bd3df5c01 None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:45:31.365890 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e6428-2e4c-4574-8e2a-379bd3df5c01 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:45:31.366214 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e6428-2e4c-4574-8e2a-379bd3df5c01 None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:45:31.367597 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 561/1120] 10.222.0.16 () {54 vars in 963 bytes} [Fri Jul 15 20:45:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 20:45:31.372528 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba2de81-4244-4788-869e-97d75dcf515d None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:45:31.372767 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba2de81-4244-4788-869e-97d75dcf515d None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:45:31.373082 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba2de81-4244-4788-869e-97d75dcf515d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:45:31.390665 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-eba2de81-4244-4788-869e-97d75dcf515d None None] MFA Rules not processed for user `d50ee89209d2474b8609861ed0a513e6`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:45:31.391871 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-eba2de81-4244-4788-869e-97d75dcf515d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:45:31.435124 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:45:31.443261 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 560/1121] 10.222.0.16 () {58 vars in 1060 bytes} [Fri Jul 15 20:45:31 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:45:31.451175 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e6428-2e4c-4574-8e2a-379bd3df5c01 None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:45:31.461787 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e6428-2e4c-4574-8e2a-379bd3df5c01 None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:45:31.465813 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc27dfd-c288-4208-99c3-21b363adfd67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd50ee89209d2474b8609861ed0a513e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:45:31.466477 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc27dfd-c288-4208-99c3-21b363adfd67 service cinder] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:45:31.466768 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc27dfd-c288-4208-99c3-21b363adfd67 service cinder] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:45:31.467073 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc27dfd-c288-4208-99c3-21b363adfd67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:45:31.477437 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc27dfd-c288-4208-99c3-21b363adfd67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:45:31.478922 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc27dfd-c288-4208-99c3-21b363adfd67 service cinder] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:45:31.488414 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 562/1122] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:45:31 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:45:31.522213 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a3fe2-ef15-4a44-8910-720dfbba8db2 None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:45:31.522510 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a3fe2-ef15-4a44-8910-720dfbba8db2 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:45:31.522800 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a3fe2-ef15-4a44-8910-720dfbba8db2 None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:45:31.524069 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 561/1123] 10.222.0.16 () {52 vars in 829 bytes} [Fri Jul 15 20:45:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:45:31.528069 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc27dfd-c288-4208-99c3-21b363adfd67 service cinder] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:45:31.588922 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc27dfd-c288-4208-99c3-21b363adfd67 service cinder] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:45:31.593397 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156486a6-1a12-43dd-a563-b0f84f64e097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5e0cb75b5f34491a7e94518c7bcdb03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:45:31.594272 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156486a6-1a12-43dd-a563-b0f84f64e097 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:45:31.594556 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156486a6-1a12-43dd-a563-b0f84f64e097 admin admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:45:31.594827 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156486a6-1a12-43dd-a563-b0f84f64e097 admin admin] PATH_INFO: `/v3/users/43af85f4437546fbbf5ed0b3154fecbf` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:45:31.596001 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156486a6-1a12-43dd-a563-b0f84f64e097 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43af85f4437546fbbf5ed0b3154fecbf)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:45:31.597001 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: WARNING py.warnings [None req-156486a6-1a12-43dd-a563-b0f84f64e097 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 20:45:31.597001 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: warnings.warn(msg) Jul 15 20:45:31.597001 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: Jul 15 20:45:31.598220 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156486a6-1a12-43dd-a563-b0f84f64e097 admin admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:45:31.659453 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.notifications [None req-156486a6-1a12-43dd-a563-b0f84f64e097 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43af85f4437546fbbf5ed0b3154fecbf'} {{(pid=98951) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:45:31.660051 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.notifications [None req-156486a6-1a12-43dd-a563-b0f84f64e097 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43af85f4437546fbbf5ed0b3154fecbf'} {{(pid=98951) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:45:31.669881 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.notifications [None req-156486a6-1a12-43dd-a563-b0f84f64e097 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43af85f4437546fbbf5ed0b3154fecbf'} {{(pid=98951) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:45:31.688540 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.notifications [None req-156486a6-1a12-43dd-a563-b0f84f64e097 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43af85f4437546fbbf5ed0b3154fecbf'} {{(pid=98951) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:45:31.700990 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.notifications [None req-156486a6-1a12-43dd-a563-b0f84f64e097 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43af85f4437546fbbf5ed0b3154fecbf'} {{(pid=98951) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:45:31.707036 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 563/1124] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jul 15 20:45:31 2022] DELETE /identity/v3/users/43af85f4437546fbbf5ed0b3154fecbf => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:45:31.711541 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fada879-9221-485d-ae3a-41e03cd38f9e None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:45:31.711838 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fada879-9221-485d-ae3a-41e03cd38f9e None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:45:31.712126 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fada879-9221-485d-ae3a-41e03cd38f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:45:31.729537 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-3fada879-9221-485d-ae3a-41e03cd38f9e None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:45:31.730775 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-3fada879-9221-485d-ae3a-41e03cd38f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:45:31.790046 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 562/1125] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jul 15 20:45:31 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:45:31.800587 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156486a6-1a12-43dd-a563-b0f84f64e097 admin admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:45:31.802175 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-156486a6-1a12-43dd-a563-b0f84f64e097 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:45:31.808070 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:45:31.860627 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156486a6-1a12-43dd-a563-b0f84f64e097 admin admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:45:31.864275 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9955a688-07c3-4350-a212-d81d8c1ec49f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3491680e892041678242f9b93617b9a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:45:31.864911 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955a688-07c3-4350-a212-d81d8c1ec49f service neutron] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:45:31.865195 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955a688-07c3-4350-a212-d81d8c1ec49f service neutron] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:45:31.865473 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955a688-07c3-4350-a212-d81d8c1ec49f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:45:31.874927 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9955a688-07c3-4350-a212-d81d8c1ec49f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:45:31.876344 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9955a688-07c3-4350-a212-d81d8c1ec49f service neutron] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:45:31.885736 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 564/1126] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:45:31 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:45:32.207082 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fada879-9221-485d-ae3a-41e03cd38f9e None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:45:32.208699 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-3fada879-9221-485d-ae3a-41e03cd38f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:45:32.221413 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fada879-9221-485d-ae3a-41e03cd38f9e None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:45:32.226478 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c7b181-e40a-4d68-a496-2624d0b22539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5e0cb75b5f34491a7e94518c7bcdb03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:45:32.227366 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c7b181-e40a-4d68-a496-2624d0b22539 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:45:32.227716 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c7b181-e40a-4d68-a496-2624d0b22539 admin admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:45:32.228061 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c7b181-e40a-4d68-a496-2624d0b22539 admin admin] PATH_INFO: `/v3/projects/37a9a709098d44e1aad681df13f5b8c4` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:45:32.230755 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c7b181-e40a-4d68-a496-2624d0b22539 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37a9a709098d44e1aad681df13f5b8c4)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:45:32.232238 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: WARNING py.warnings [None req-74c7b181-e40a-4d68-a496-2624d0b22539 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 20:45:32.232238 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: warnings.warn(msg) Jul 15 20:45:32.232238 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: Jul 15 20:45:32.234176 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c7b181-e40a-4d68-a496-2624d0b22539 admin admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:45:32.294906 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.notifications [None req-74c7b181-e40a-4d68-a496-2624d0b22539 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37a9a709098d44e1aad681df13f5b8c4', 'request_id': 'req-74c7b181-e40a-4d68-a496-2624d0b22539'} {{(pid=98952) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:45:32.300896 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.notifications [None req-74c7b181-e40a-4d68-a496-2624d0b22539 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37a9a709098d44e1aad681df13f5b8c4', 'request_id': 'req-74c7b181-e40a-4d68-a496-2624d0b22539'} {{(pid=98952) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:45:32.311327 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.notifications [None req-74c7b181-e40a-4d68-a496-2624d0b22539 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37a9a709098d44e1aad681df13f5b8c4', 'request_id': 'req-74c7b181-e40a-4d68-a496-2624d0b22539'} {{(pid=98952) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:45:32.329179 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.notifications [None req-74c7b181-e40a-4d68-a496-2624d0b22539 admin admin] The token cache is being invalidate because project 37a9a709098d44e1aad681df13f5b8c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98952) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:45:32.329470 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.notifications [None req-74c7b181-e40a-4d68-a496-2624d0b22539 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98952) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:45:32.330131 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.notifications [None req-74c7b181-e40a-4d68-a496-2624d0b22539 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98952) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:45:32.331778 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 563/1127] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jul 15 20:45:32 2022] DELETE /identity/v3/projects/37a9a709098d44e1aad681df13f5b8c4 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:45:41.881649 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=25 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:45:42.326193 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:46:54.492324 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8bd8f-762b-404e-add8-c3d1bae391b2 None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:46:54.492913 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8bd8f-762b-404e-add8-c3d1bae391b2 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:46:54.492913 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8bd8f-762b-404e-add8-c3d1bae391b2 None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:46:54.494355 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 565/1128] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 20:46:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:46:54.500012 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf07baf6-b58e-4291-8f06-7426ec8b0cdd None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:46:54.500489 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf07baf6-b58e-4291-8f06-7426ec8b0cdd None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:46:54.500598 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf07baf6-b58e-4291-8f06-7426ec8b0cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:46:54.579446 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-bf07baf6-b58e-4291-8f06-7426ec8b0cdd None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:46:54.580681 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-bf07baf6-b58e-4291-8f06-7426ec8b0cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:46:54.681178 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 564/1129] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 20:46:54 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:46:54.845840 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b8bd8f-762b-404e-add8-c3d1bae391b2 None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:46:54.847556 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-46b8bd8f-762b-404e-add8-c3d1bae391b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:46:54.946448 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b8bd8f-762b-404e-add8-c3d1bae391b2 None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:46:54.952009 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aef974-3b77-4627-ae6b-f6e9f68ff415 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e5296637584004b1888453ab9056c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:46:54.952657 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aef974-3b77-4627-ae6b-f6e9f68ff415 service nova] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:46:54.952941 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aef974-3b77-4627-ae6b-f6e9f68ff415 service nova] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:46:54.953218 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aef974-3b77-4627-ae6b-f6e9f68ff415 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:46:54.962634 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aef974-3b77-4627-ae6b-f6e9f68ff415 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:46:54.964296 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aef974-3b77-4627-ae6b-f6e9f68ff415 service nova] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:46:54.976409 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 566/1130] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:46:54 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:46:55.834096 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc9375-7289-4459-9ca9-619c7dc4a761 None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:46:55.834614 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc9375-7289-4459-9ca9-619c7dc4a761 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:46:55.834614 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc9375-7289-4459-9ca9-619c7dc4a761 None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:46:55.835933 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 565/1131] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 20:46:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:46:55.841778 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4036e1a6-2fb9-4e8c-8d30-a8185b8a203d None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:46:55.842304 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4036e1a6-2fb9-4e8c-8d30-a8185b8a203d None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:46:55.842403 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4036e1a6-2fb9-4e8c-8d30-a8185b8a203d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:46:55.861066 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-4036e1a6-2fb9-4e8c-8d30-a8185b8a203d None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:46:55.862354 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-4036e1a6-2fb9-4e8c-8d30-a8185b8a203d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:46:55.870250 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 567/1132] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 20:46:55 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:46:56.042028 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fc9375-7289-4459-9ca9-619c7dc4a761 None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:46:56.058556 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fc9375-7289-4459-9ca9-619c7dc4a761 None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:46:56.063833 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d883aa-d7ab-4ca3-981d-5033e3f2f13c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e5296637584004b1888453ab9056c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:46:56.064489 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d883aa-d7ab-4ca3-981d-5033e3f2f13c service nova] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:46:56.064780 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d883aa-d7ab-4ca3-981d-5033e3f2f13c service nova] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:46:56.065076 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d883aa-d7ab-4ca3-981d-5033e3f2f13c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:46:56.075050 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d883aa-d7ab-4ca3-981d-5033e3f2f13c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:46:56.076677 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d883aa-d7ab-4ca3-981d-5033e3f2f13c service nova] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:46:56.086927 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 566/1133] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:46:56 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 20:47:00.340829 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ee7df-21ce-4c7d-aa0b-478e2008d12a None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:00.341340 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ee7df-21ce-4c7d-aa0b-478e2008d12a None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:00.341340 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ee7df-21ce-4c7d-aa0b-478e2008d12a None None] PATH_INFO: `/v3` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:00.342634 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 568/1134] 10.222.0.59 () {54 vars in 925 bytes} [Fri Jul 15 20:47:00 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:47:00.349396 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6187471e-7d40-48db-9eeb-649e14436f06 None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:00.349823 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6187471e-7d40-48db-9eeb-649e14436f06 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:00.349986 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6187471e-7d40-48db-9eeb-649e14436f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:00.377457 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-6187471e-7d40-48db-9eeb-649e14436f06 None None] MFA Rules not processed for user `913ad55c6c7b4c41ac22dd0a93ef656c`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:47:00.378980 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-6187471e-7d40-48db-9eeb-649e14436f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:47:00.433609 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=100 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:47:00.443135 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 567/1135] 10.222.0.59 () {58 vars in 1015 bytes} [Fri Jul 15 20:47:00 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:47:05.856243 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=42 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:47:07.356401 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42620488-3240-4724-980c-8b3386a56d8f None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:07.357109 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42620488-3240-4724-980c-8b3386a56d8f None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:07.357109 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42620488-3240-4724-980c-8b3386a56d8f None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:07.358581 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 569/1136] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 20:47:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:47:07.364248 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb2f77f-1853-44a8-9ec6-9e008424937a None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:07.364751 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb2f77f-1853-44a8-9ec6-9e008424937a None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:07.365213 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb2f77f-1853-44a8-9ec6-9e008424937a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:07.387648 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-bdb2f77f-1853-44a8-9ec6-9e008424937a None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:47:07.389489 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-bdb2f77f-1853-44a8-9ec6-9e008424937a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:47:07.397930 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 568/1137] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 20:47:07 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:47:07.560878 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42620488-3240-4724-980c-8b3386a56d8f None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:47:07.576038 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42620488-3240-4724-980c-8b3386a56d8f None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:47:07.581406 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e6a10b-983a-43c7-88d2-f90748cd9435 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e5296637584004b1888453ab9056c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:47:07.582053 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6a10b-983a-43c7-88d2-f90748cd9435 service nova] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:07.582372 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6a10b-983a-43c7-88d2-f90748cd9435 service nova] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:07.582649 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6a10b-983a-43c7-88d2-f90748cd9435 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:07.593014 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e6a10b-983a-43c7-88d2-f90748cd9435 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:47:07.594666 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e6a10b-983a-43c7-88d2-f90748cd9435 service nova] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:47:07.605821 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 570/1138] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:47:07 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:47:08.430244 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eae1b0-3347-4703-99f8-843aca334a09 None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:08.430780 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eae1b0-3347-4703-99f8-843aca334a09 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:08.430878 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eae1b0-3347-4703-99f8-843aca334a09 None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:08.432173 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 569/1139] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 20:47:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 20:47:08.437696 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be64d074-ce25-46fe-8051-7a74ba5d743a None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:08.438101 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be64d074-ce25-46fe-8051-7a74ba5d743a None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:08.438285 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be64d074-ce25-46fe-8051-7a74ba5d743a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:08.456283 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-be64d074-ce25-46fe-8051-7a74ba5d743a None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:47:08.457483 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-be64d074-ce25-46fe-8051-7a74ba5d743a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:47:08.465248 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 571/1140] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 20:47:08 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 20:47:08.628238 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eae1b0-3347-4703-99f8-843aca334a09 None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:47:08.643173 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eae1b0-3347-4703-99f8-843aca334a09 None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:47:08.648022 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce81bff6-eb20-45c6-b115-8a039f55d8bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e5296637584004b1888453ab9056c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:47:08.648668 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81bff6-eb20-45c6-b115-8a039f55d8bc service nova] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:08.648952 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81bff6-eb20-45c6-b115-8a039f55d8bc service nova] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:08.649228 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81bff6-eb20-45c6-b115-8a039f55d8bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:08.658256 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce81bff6-eb20-45c6-b115-8a039f55d8bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:47:08.659927 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce81bff6-eb20-45c6-b115-8a039f55d8bc service nova] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:47:08.670262 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 570/1141] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:47:08 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:47:09.313591 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96684205-ba3b-4f33-9522-4f0213e9ab69 None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:09.313804 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96684205-ba3b-4f33-9522-4f0213e9ab69 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:09.314061 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96684205-ba3b-4f33-9522-4f0213e9ab69 None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:09.315452 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 572/1142] 10.222.0.16 () {54 vars in 960 bytes} [Fri Jul 15 20:47:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:47:09.320577 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9293dbbd-3d29-42a1-a1ee-417178e0ade7 None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:09.320869 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9293dbbd-3d29-42a1-a1ee-417178e0ade7 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:09.321151 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9293dbbd-3d29-42a1-a1ee-417178e0ade7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:09.340311 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-9293dbbd-3d29-42a1-a1ee-417178e0ade7 None None] MFA Rules not processed for user `913ad55c6c7b4c41ac22dd0a93ef656c`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:47:09.341476 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-9293dbbd-3d29-42a1-a1ee-417178e0ade7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:47:09.349847 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 571/1143] 10.222.0.16 () {58 vars in 1057 bytes} [Fri Jul 15 20:47:09 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 20:47:09.357482 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96684205-ba3b-4f33-9522-4f0213e9ab69 None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:47:09.370647 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96684205-ba3b-4f33-9522-4f0213e9ab69 None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:47:09.375513 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6936d782-b457-46d0-bb41-12f009804b62 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913ad55c6c7b4c41ac22dd0a93ef656c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:47:09.376136 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936d782-b457-46d0-bb41-12f009804b62 service placement] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:09.376422 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936d782-b457-46d0-bb41-12f009804b62 service placement] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:09.376698 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936d782-b457-46d0-bb41-12f009804b62 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:09.384781 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6936d782-b457-46d0-bb41-12f009804b62 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:47:09.386949 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6936d782-b457-46d0-bb41-12f009804b62 service placement] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:47:09.396653 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 573/1144] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:47:09 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:47:12.845122 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b5c07a-5e66-49f5-a1e8-fe6f8f5e0526 None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:12.845643 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b5c07a-5e66-49f5-a1e8-fe6f8f5e0526 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:12.845643 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b5c07a-5e66-49f5-a1e8-fe6f8f5e0526 None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:12.847147 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 572/1145] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 20:47:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:47:12.852293 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c9695-76fc-49f2-b6c6-c13068c26c3f None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:12.852760 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c9695-76fc-49f2-b6c6-c13068c26c3f None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:12.852868 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c9695-76fc-49f2-b6c6-c13068c26c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:12.879914 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-d09c9695-76fc-49f2-b6c6-c13068c26c3f None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:47:12.881114 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-d09c9695-76fc-49f2-b6c6-c13068c26c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:47:12.888949 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 574/1146] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 20:47:12 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:47:12.926364 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b5c07a-5e66-49f5-a1e8-fe6f8f5e0526 None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:47:12.927998 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-e0b5c07a-5e66-49f5-a1e8-fe6f8f5e0526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:47:12.985077 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b5c07a-5e66-49f5-a1e8-fe6f8f5e0526 None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:47:12.988706 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b063cae-ed39-4b56-9822-86eda998b49e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3491680e892041678242f9b93617b9a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:47:12.989347 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b063cae-ed39-4b56-9822-86eda998b49e service neutron] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:12.989636 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b063cae-ed39-4b56-9822-86eda998b49e service neutron] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:12.989916 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b063cae-ed39-4b56-9822-86eda998b49e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:12.999268 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b063cae-ed39-4b56-9822-86eda998b49e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:47:13.000701 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b063cae-ed39-4b56-9822-86eda998b49e service neutron] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:47:13.009992 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 573/1147] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:47:12 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:47:15.249584 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88895d93-5c87-4788-a10c-47274d3b127b None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:15.250155 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88895d93-5c87-4788-a10c-47274d3b127b None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:15.250155 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88895d93-5c87-4788-a10c-47274d3b127b None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:15.251551 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 575/1148] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 20:47:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:47:15.256853 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f6e6ea-ab5c-4324-ba80-45bedbc350ca None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:15.257282 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f6e6ea-ab5c-4324-ba80-45bedbc350ca None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:15.257420 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f6e6ea-ab5c-4324-ba80-45bedbc350ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:15.275197 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-73f6e6ea-ab5c-4324-ba80-45bedbc350ca None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:47:15.276434 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-73f6e6ea-ab5c-4324-ba80-45bedbc350ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:47:15.284142 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 574/1149] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 20:47:15 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:47:15.321271 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88895d93-5c87-4788-a10c-47274d3b127b None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:47:15.332618 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88895d93-5c87-4788-a10c-47274d3b127b None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:47:15.336379 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ad3b7a-c4f1-4837-9149-f57b09477591 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3491680e892041678242f9b93617b9a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:47:15.337019 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad3b7a-c4f1-4837-9149-f57b09477591 service neutron] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:15.337302 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad3b7a-c4f1-4837-9149-f57b09477591 service neutron] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:15.337575 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad3b7a-c4f1-4837-9149-f57b09477591 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:15.347669 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ad3b7a-c4f1-4837-9149-f57b09477591 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:47:15.349090 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ad3b7a-c4f1-4837-9149-f57b09477591 service neutron] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:47:15.359480 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 576/1150] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:47:15 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:47:19.261106 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be964441-9255-4364-bbf9-424bf273b614 None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:19.261671 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be964441-9255-4364-bbf9-424bf273b614 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:19.261671 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be964441-9255-4364-bbf9-424bf273b614 None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:19.263078 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 575/1151] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 20:47:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:47:19.268406 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f676cf1-8cbf-4f17-a942-a5e9b0a7499e None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:19.268835 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f676cf1-8cbf-4f17-a942-a5e9b0a7499e None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:19.268964 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f676cf1-8cbf-4f17-a942-a5e9b0a7499e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:19.286591 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-3f676cf1-8cbf-4f17-a942-a5e9b0a7499e None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:47:19.287801 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-3f676cf1-8cbf-4f17-a942-a5e9b0a7499e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:47:19.295640 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 577/1152] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 20:47:19 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:47:19.569807 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be964441-9255-4364-bbf9-424bf273b614 None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:47:19.571552 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-be964441-9255-4364-bbf9-424bf273b614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:47:19.631639 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be964441-9255-4364-bbf9-424bf273b614 None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:47:19.635181 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d682c0-34a1-47b9-a378-ae43cd59b941 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd50ee89209d2474b8609861ed0a513e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:47:19.635846 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d682c0-34a1-47b9-a378-ae43cd59b941 service cinder] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:19.636131 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d682c0-34a1-47b9-a378-ae43cd59b941 service cinder] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:19.636409 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d682c0-34a1-47b9-a378-ae43cd59b941 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:19.647948 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d682c0-34a1-47b9-a378-ae43cd59b941 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:47:19.649391 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d682c0-34a1-47b9-a378-ae43cd59b941 service cinder] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:47:19.659039 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 576/1153] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:47:19 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:47:21.912739 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157aba8-8158-4d0e-a243-c91d9fdd0f0e None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:21.913261 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157aba8-8158-4d0e-a243-c91d9fdd0f0e None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:21.913261 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157aba8-8158-4d0e-a243-c91d9fdd0f0e None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:21.914686 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 578/1154] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 20:47:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:47:21.920479 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4dc287-f983-417d-8f4b-d670fcd633a0 None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:21.920896 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4dc287-f983-417d-8f4b-d670fcd633a0 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:21.921075 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4dc287-f983-417d-8f4b-d670fcd633a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:21.939367 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-9d4dc287-f983-417d-8f4b-d670fcd633a0 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:47:21.940561 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-9d4dc287-f983-417d-8f4b-d670fcd633a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:47:21.948270 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 577/1155] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 20:47:21 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:47:22.226369 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2157aba8-8158-4d0e-a243-c91d9fdd0f0e None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:47:22.228073 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-2157aba8-8158-4d0e-a243-c91d9fdd0f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:47:22.241536 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2157aba8-8158-4d0e-a243-c91d9fdd0f0e None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:47:22.245023 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695143cc-5cd0-4d8d-adeb-20141371a16c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd50ee89209d2474b8609861ed0a513e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:47:22.245658 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695143cc-5cd0-4d8d-adeb-20141371a16c service cinder] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:22.245945 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695143cc-5cd0-4d8d-adeb-20141371a16c service cinder] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:22.246269 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695143cc-5cd0-4d8d-adeb-20141371a16c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:22.255109 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695143cc-5cd0-4d8d-adeb-20141371a16c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:47:22.256573 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695143cc-5cd0-4d8d-adeb-20141371a16c service cinder] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:47:22.266017 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 579/1156] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:47:22 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:47:31.934411 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=70 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:47:32.261958 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=33 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:48:40.010718 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cca62a-d4f3-4b45-b928-3de86457891d None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:48:40.011365 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cca62a-d4f3-4b45-b928-3de86457891d None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:48:40.011365 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cca62a-d4f3-4b45-b928-3de86457891d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:48:40.029097 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-61cca62a-d4f3-4b45-b928-3de86457891d None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:48:40.030353 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-61cca62a-d4f3-4b45-b928-3de86457891d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:48:40.038087 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 578/1157] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jul 15 20:48:40 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:48:40.046767 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267bcd91-6946-4db6-b85d-b87dacd3ba2e None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:48:40.046932 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f957781-18a8-46d0-916f-ee0651ff179c None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:48:40.047402 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267bcd91-6946-4db6-b85d-b87dacd3ba2e None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:48:40.047500 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f957781-18a8-46d0-916f-ee0651ff179c None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:48:40.047595 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267bcd91-6946-4db6-b85d-b87dacd3ba2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:48:40.047699 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f957781-18a8-46d0-916f-ee0651ff179c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:48:40.065729 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-8f957781-18a8-46d0-916f-ee0651ff179c None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:48:40.066485 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-267bcd91-6946-4db6-b85d-b87dacd3ba2e None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:48:40.066989 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-8f957781-18a8-46d0-916f-ee0651ff179c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:48:40.067639 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-267bcd91-6946-4db6-b85d-b87dacd3ba2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:48:40.074694 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 580/1158] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jul 15 20:48:40 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:48:40.075761 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 579/1159] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jul 15 20:48:40 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 20:48:40.079455 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f957781-18a8-46d0-916f-ee0651ff179c None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:48:40.083432 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63a620e-d1d4-4ae4-b56c-6f1247765cca None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:48:40.083915 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63a620e-d1d4-4ae4-b56c-6f1247765cca None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:48:40.084231 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63a620e-d1d4-4ae4-b56c-6f1247765cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:48:40.088494 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f957781-18a8-46d0-916f-ee0651ff179c None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:48:40.092942 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b16a594-4b3a-4b7f-8c56-30d831193ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5e0cb75b5f34491a7e94518c7bcdb03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:48:40.093580 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b16a594-4b3a-4b7f-8c56-30d831193ab8 admin admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:48:40.093866 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b16a594-4b3a-4b7f-8c56-30d831193ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:48:40.094202 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b16a594-4b3a-4b7f-8c56-30d831193ab8 admin admin] PATH_INFO: `/v3/domains` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:48:40.095055 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b16a594-4b3a-4b7f-8c56-30d831193ab8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:48:40.095361 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b16a594-4b3a-4b7f-8c56-30d831193ab8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:48:40.096362 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: WARNING py.warnings [None req-6b16a594-4b3a-4b7f-8c56-30d831193ab8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 15 20:48:40.096362 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: warnings.warn(msg) Jul 15 20:48:40.096362 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: Jul 15 20:48:40.097265 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b16a594-4b3a-4b7f-8c56-30d831193ab8 admin admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:48:40.102432 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-b63a620e-d1d4-4ae4-b56c-6f1247765cca None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:48:40.104137 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-b63a620e-d1d4-4ae4-b56c-6f1247765cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:48:40.109576 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 581/1160] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jul 15 20:48:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:48:40.115528 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 580/1161] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jul 15 20:48:40 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 20:48:40.117146 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63a620e-d1d4-4ae4-b56c-6f1247765cca None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:48:40.117279 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b16a594-4b3a-4b7f-8c56-30d831193ab8 admin admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:48:40.127283 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63a620e-d1d4-4ae4-b56c-6f1247765cca None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:48:40.127539 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b16a594-4b3a-4b7f-8c56-30d831193ab8 admin admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:48:40.131794 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2439e0-e2c5-42d2-b576-dfc351353e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5e0cb75b5f34491a7e94518c7bcdb03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:48:40.132053 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf488c6-db8f-4afb-be6f-1797084ae331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5e0cb75b5f34491a7e94518c7bcdb03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:48:40.132434 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2439e0-e2c5-42d2-b576-dfc351353e21 admin admin] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:48:40.132723 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2439e0-e2c5-42d2-b576-dfc351353e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:48:40.132823 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf488c6-db8f-4afb-be6f-1797084ae331 admin admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:48:40.133003 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2439e0-e2c5-42d2-b576-dfc351353e21 admin admin] PATH_INFO: `/v3/projects` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:48:40.133109 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf488c6-db8f-4afb-be6f-1797084ae331 admin admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:48:40.133344 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf488c6-db8f-4afb-be6f-1797084ae331 admin admin] PATH_INFO: `/v3/domains` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:48:40.133683 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2439e0-e2c5-42d2-b576-dfc351353e21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:48:40.134062 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf488c6-db8f-4afb-be6f-1797084ae331 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98951) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:48:40.134452 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf488c6-db8f-4afb-be6f-1797084ae331 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:48:40.134737 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: WARNING py.warnings [None req-db2439e0-e2c5-42d2-b576-dfc351353e21 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 20:48:40.134737 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: warnings.warn(msg) Jul 15 20:48:40.134737 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: Jul 15 20:48:40.135930 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2439e0-e2c5-42d2-b576-dfc351353e21 admin admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:48:40.136045 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf488c6-db8f-4afb-be6f-1797084ae331 admin admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:48:40.147974 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 582/1162] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jul 15 20:48:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:48:40.156009 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf488c6-db8f-4afb-be6f-1797084ae331 admin admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:48:40.166543 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf488c6-db8f-4afb-be6f-1797084ae331 admin admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:48:40.171617 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be891cc8-9bd4-4d7f-9c4e-481d4978757f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5e0cb75b5f34491a7e94518c7bcdb03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:48:40.172333 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be891cc8-9bd4-4d7f-9c4e-481d4978757f admin admin] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:48:40.172618 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be891cc8-9bd4-4d7f-9c4e-481d4978757f admin admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:48:40.172892 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be891cc8-9bd4-4d7f-9c4e-481d4978757f admin admin] PATH_INFO: `/v3/projects` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:48:40.173578 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be891cc8-9bd4-4d7f-9c4e-481d4978757f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:48:40.175526 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be891cc8-9bd4-4d7f-9c4e-481d4978757f admin admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:48:40.179290 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 581/1163] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jul 15 20:48:40 2022] POST /identity/v3/projects => generated 379 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 20:48:40.183998 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2439e0-e2c5-42d2-b576-dfc351353e21 admin admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:48:40.201959 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 583/1164] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jul 15 20:48:40 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 20:48:40.206142 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be891cc8-9bd4-4d7f-9c4e-481d4978757f admin admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:48:40.249732 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2439e0-e2c5-42d2-b576-dfc351353e21 admin admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:48:40.268187 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be891cc8-9bd4-4d7f-9c4e-481d4978757f admin admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:48:40.272688 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7854d9a-4872-4e3f-903e-5468fd9d3409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5e0cb75b5f34491a7e94518c7bcdb03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:48:40.273355 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7854d9a-4872-4e3f-903e-5468fd9d3409 admin admin] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:48:40.273647 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7854d9a-4872-4e3f-903e-5468fd9d3409 admin admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:48:40.274013 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7854d9a-4872-4e3f-903e-5468fd9d3409 admin admin] PATH_INFO: `/v3/users` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:48:40.274723 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7854d9a-4872-4e3f-903e-5468fd9d3409 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:48:40.276259 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: WARNING py.warnings [None req-d7854d9a-4872-4e3f-903e-5468fd9d3409 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 20:48:40.276259 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: warnings.warn(msg) Jul 15 20:48:40.276259 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: Jul 15 20:48:40.277474 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7854d9a-4872-4e3f-903e-5468fd9d3409 admin admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:48:40.299632 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 584/1165] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jul 15 20:48:40 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 20:48:40.303388 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7854d9a-4872-4e3f-903e-5468fd9d3409 admin admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:48:40.312180 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375cffb4-13b5-4048-90dd-c1a5a0132689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5e0cb75b5f34491a7e94518c7bcdb03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:48:40.312885 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375cffb4-13b5-4048-90dd-c1a5a0132689 admin admin] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:48:40.313173 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375cffb4-13b5-4048-90dd-c1a5a0132689 admin admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:48:40.313289 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7854d9a-4872-4e3f-903e-5468fd9d3409 admin admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:48:40.313480 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375cffb4-13b5-4048-90dd-c1a5a0132689 admin admin] PATH_INFO: `/v3/users` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:48:40.314190 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375cffb4-13b5-4048-90dd-c1a5a0132689 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:48:40.316277 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375cffb4-13b5-4048-90dd-c1a5a0132689 admin admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:48:40.318110 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673be772-4dad-466e-bfb3-9a952f178d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5e0cb75b5f34491a7e94518c7bcdb03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:48:40.318769 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673be772-4dad-466e-bfb3-9a952f178d46 admin admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:48:40.319057 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673be772-4dad-466e-bfb3-9a952f178d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:48:40.319365 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673be772-4dad-466e-bfb3-9a952f178d46 admin admin] PATH_INFO: `/v3/roles` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:48:40.320089 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673be772-4dad-466e-bfb3-9a952f178d46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:48:40.321695 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673be772-4dad-466e-bfb3-9a952f178d46 admin admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:48:40.333444 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 585/1166] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jul 15 20:48:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 20:48:40.337215 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673be772-4dad-466e-bfb3-9a952f178d46 admin admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:48:40.342138 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 582/1167] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jul 15 20:48:40 2022] POST /identity/v3/users => generated 290 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 20:48:40.345920 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375cffb4-13b5-4048-90dd-c1a5a0132689 admin admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:48:40.347542 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673be772-4dad-466e-bfb3-9a952f178d46 admin admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:48:40.352831 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19e24b6-99be-4937-b6a6-c7738a3620bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5e0cb75b5f34491a7e94518c7bcdb03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:48:40.354298 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e24b6-99be-4937-b6a6-c7738a3620bb admin admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:48:40.354588 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e24b6-99be-4937-b6a6-c7738a3620bb admin admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:48:40.354869 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e24b6-99be-4937-b6a6-c7738a3620bb admin admin] PATH_INFO: `/v3/roles` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:48:40.355623 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19e24b6-99be-4937-b6a6-c7738a3620bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:48:40.356223 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375cffb4-13b5-4048-90dd-c1a5a0132689 admin admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:48:40.357228 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19e24b6-99be-4937-b6a6-c7738a3620bb admin admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:48:40.360918 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36587a3-b965-42a2-9fb4-ccac3dce0604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5e0cb75b5f34491a7e94518c7bcdb03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:48:40.361570 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36587a3-b965-42a2-9fb4-ccac3dce0604 admin admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:48:40.361862 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36587a3-b965-42a2-9fb4-ccac3dce0604 admin admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:48:40.362169 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36587a3-b965-42a2-9fb4-ccac3dce0604 admin admin] PATH_INFO: `/v3/roles` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:48:40.362888 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36587a3-b965-42a2-9fb4-ccac3dce0604 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:48:40.364506 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36587a3-b965-42a2-9fb4-ccac3dce0604 admin admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:48:40.367363 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 586/1168] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jul 15 20:48:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:48:40.371561 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19e24b6-99be-4937-b6a6-c7738a3620bb admin admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:48:40.374727 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 583/1169] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jul 15 20:48:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 20:48:40.378656 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36587a3-b965-42a2-9fb4-ccac3dce0604 admin admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:48:40.381154 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19e24b6-99be-4937-b6a6-c7738a3620bb admin admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:48:40.385679 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d973e4a2-3866-4507-9876-05ed77ae95eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5e0cb75b5f34491a7e94518c7bcdb03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:48:40.386580 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d973e4a2-3866-4507-9876-05ed77ae95eb admin admin] REQUEST_METHOD: `PUT` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:48:40.386869 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d973e4a2-3866-4507-9876-05ed77ae95eb admin admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:48:40.387150 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d973e4a2-3866-4507-9876-05ed77ae95eb admin admin] PATH_INFO: `/v3/projects/2de76c10093c41f69722889b0398d14b/users/f7dea4f74fa9403aba00ece617f77b89/roles/478906d6337444e68ea74da908d9a24d` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:48:40.388740 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36587a3-b965-42a2-9fb4-ccac3dce0604 admin admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:48:40.393295 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff3d6b5-65dc-4b05-ac0a-9bc442a3da31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5e0cb75b5f34491a7e94518c7bcdb03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:48:40.393975 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff3d6b5-65dc-4b05-ac0a-9bc442a3da31 admin admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:48:40.394296 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff3d6b5-65dc-4b05-ac0a-9bc442a3da31 admin admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:48:40.394584 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff3d6b5-65dc-4b05-ac0a-9bc442a3da31 admin admin] PATH_INFO: `/v3/roles` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:48:40.395297 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff3d6b5-65dc-4b05-ac0a-9bc442a3da31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:48:40.396911 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff3d6b5-65dc-4b05-ac0a-9bc442a3da31 admin admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:48:40.402637 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d973e4a2-3866-4507-9876-05ed77ae95eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=2de76c10093c41f69722889b0398d14b, user_id=f7dea4f74fa9403aba00ece617f77b89, role_id=478906d6337444e68ea74da908d9a24d)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:48:40.405328 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d973e4a2-3866-4507-9876-05ed77ae95eb admin admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:48:40.408922 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 584/1170] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jul 15 20:48:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 20:48:40.413427 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff3d6b5-65dc-4b05-ac0a-9bc442a3da31 admin admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:48:40.420096 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 587/1171] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jul 15 20:48:40 2022] PUT /identity/v3/projects/2de76c10093c41f69722889b0398d14b/users/f7dea4f74fa9403aba00ece617f77b89/roles/478906d6337444e68ea74da908d9a24d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 20:48:40.423825 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff3d6b5-65dc-4b05-ac0a-9bc442a3da31 admin admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:48:40.425551 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319431bf-6a37-4106-aa76-f2cc1c889b3a None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:48:40.425942 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319431bf-6a37-4106-aa76-f2cc1c889b3a None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:48:40.426346 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319431bf-6a37-4106-aa76-f2cc1c889b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:48:40.443112 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-319431bf-6a37-4106-aa76-f2cc1c889b3a None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:48:40.443445 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:48:40.444327 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-319431bf-6a37-4106-aa76-f2cc1c889b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:48:40.487536 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac18d2a-abb2-4b41-8ce6-721b9204025c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5e0cb75b5f34491a7e94518c7bcdb03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:48:40.488435 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac18d2a-abb2-4b41-8ce6-721b9204025c admin admin] REQUEST_METHOD: `PUT` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:48:40.488721 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac18d2a-abb2-4b41-8ce6-721b9204025c admin admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:48:40.489000 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac18d2a-abb2-4b41-8ce6-721b9204025c admin admin] PATH_INFO: `/v3/projects/9023965425c74a78bc31f8b2eeef9d81/users/a9778171a01b491b800c5fe175f27086/roles/478906d6337444e68ea74da908d9a24d` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:48:40.491102 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:48:40.503507 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac18d2a-abb2-4b41-8ce6-721b9204025c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9023965425c74a78bc31f8b2eeef9d81, user_id=a9778171a01b491b800c5fe175f27086, role_id=478906d6337444e68ea74da908d9a24d)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:48:40.504542 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: WARNING py.warnings [None req-1ac18d2a-abb2-4b41-8ce6-721b9204025c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 20:48:40.504542 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: warnings.warn(msg) Jul 15 20:48:40.504542 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: Jul 15 20:48:40.506520 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac18d2a-abb2-4b41-8ce6-721b9204025c admin admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:48:40.508012 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 588/1172] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jul 15 20:48:40 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 20:48:40.518548 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319431bf-6a37-4106-aa76-f2cc1c889b3a None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:48:40.520702 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 585/1173] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jul 15 20:48:40 2022] PUT /identity/v3/projects/9023965425c74a78bc31f8b2eeef9d81/users/a9778171a01b491b800c5fe175f27086/roles/478906d6337444e68ea74da908d9a24d => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 20:48:40.526555 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd90c6d7-4ca1-4e0a-9436-870fda8c0238 None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:48:40.526914 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd90c6d7-4ca1-4e0a-9436-870fda8c0238 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:48:40.527261 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd90c6d7-4ca1-4e0a-9436-870fda8c0238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:48:40.544463 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-bd90c6d7-4ca1-4e0a-9436-870fda8c0238 None None] MFA Rules not processed for user `904f3e39010c4ee1ad10cdd271b0b153`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:48:40.545744 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-bd90c6d7-4ca1-4e0a-9436-870fda8c0238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:48:40.576800 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319431bf-6a37-4106-aa76-f2cc1c889b3a None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:48:40.605620 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 586/1174] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jul 15 20:48:40 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 20:48:40.615510 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd90c6d7-4ca1-4e0a-9436-870fda8c0238 None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:48:40.629334 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f329c1-c6ad-4c9c-8fd2-19787bb83c6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3491680e892041678242f9b93617b9a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:48:40.629990 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f329c1-c6ad-4c9c-8fd2-19787bb83c6c service neutron] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:48:40.630334 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f329c1-c6ad-4c9c-8fd2-19787bb83c6c service neutron] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:48:40.630618 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f329c1-c6ad-4c9c-8fd2-19787bb83c6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:48:40.640989 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f329c1-c6ad-4c9c-8fd2-19787bb83c6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:48:40.642472 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f329c1-c6ad-4c9c-8fd2-19787bb83c6c service neutron] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:48:40.652906 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 589/1175] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:48:40 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 20:48:40.672482 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd90c6d7-4ca1-4e0a-9436-870fda8c0238 None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:48:40.676974 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac60b49-812c-4351-8015-7952a3f780d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3491680e892041678242f9b93617b9a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:48:40.677774 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac60b49-812c-4351-8015-7952a3f780d7 service neutron] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:48:40.678170 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac60b49-812c-4351-8015-7952a3f780d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:48:40.678529 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac60b49-812c-4351-8015-7952a3f780d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:48:40.688399 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac60b49-812c-4351-8015-7952a3f780d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:48:40.689879 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac60b49-812c-4351-8015-7952a3f780d7 service neutron] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:48:40.699878 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 587/1176] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:48:40 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 20:48:47.174061 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c3a8b8-0d6c-4daa-b579-1be3ba6081c3 None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:48:47.174615 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c3a8b8-0d6c-4daa-b579-1be3ba6081c3 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:48:47.174615 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c3a8b8-0d6c-4daa-b579-1be3ba6081c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:48:47.237529 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-48c3a8b8-0d6c-4daa-b579-1be3ba6081c3 None None] MFA Rules not processed for user `f7dea4f74fa9403aba00ece617f77b89`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:48:47.238796 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-48c3a8b8-0d6c-4daa-b579-1be3ba6081c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:48:47.272741 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c055d-9dcb-4a52-a79c-5e270eeead49 None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:48:47.273511 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c055d-9dcb-4a52-a79c-5e270eeead49 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:48:47.273904 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c055d-9dcb-4a52-a79c-5e270eeead49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:48:47.313691 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-280c055d-9dcb-4a52-a79c-5e270eeead49 None None] MFA Rules not processed for user `a9778171a01b491b800c5fe175f27086`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:48:47.315095 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-280c055d-9dcb-4a52-a79c-5e270eeead49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:48:47.336917 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 590/1177] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jul 15 20:48:47 2022] POST /identity/v3/auth/tokens => generated 2810 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:48:47.338526 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c3a8b8-0d6c-4daa-b579-1be3ba6081c3 None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:48:47.351725 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c3a8b8-0d6c-4daa-b579-1be3ba6081c3 None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:48:47.358692 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ece837-e3da-4306-83ed-53aa979c68c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5e0cb75b5f34491a7e94518c7bcdb03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:48:47.359912 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ece837-e3da-4306-83ed-53aa979c68c9 admin admin] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:48:47.360204 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ece837-e3da-4306-83ed-53aa979c68c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:48:47.360487 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ece837-e3da-4306-83ed-53aa979c68c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:48:47.361321 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ece837-e3da-4306-83ed-53aa979c68c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:48:47.363328 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ece837-e3da-4306-83ed-53aa979c68c9 admin admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:48:47.369964 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:48:47.418004 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 591/1178] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jul 15 20:48:47 2022] POST /identity/v3/projects => generated 383 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 20:48:47.420092 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ece837-e3da-4306-83ed-53aa979c68c9 admin admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:48:47.425347 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 588/1179] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jul 15 20:48:47 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:48:47.428630 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280c055d-9dcb-4a52-a79c-5e270eeead49 None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:48:47.442326 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280c055d-9dcb-4a52-a79c-5e270eeead49 None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:48:47.452688 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:48:47.508452 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ece837-e3da-4306-83ed-53aa979c68c9 admin admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:48:47.511675 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18ce159-2161-43fb-9864-d6b934125a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5e0cb75b5f34491a7e94518c7bcdb03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:48:47.512386 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ce159-2161-43fb-9864-d6b934125a08 admin admin] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:48:47.512661 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ce159-2161-43fb-9864-d6b934125a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:48:47.512946 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ce159-2161-43fb-9864-d6b934125a08 admin admin] PATH_INFO: `/v3/projects` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:48:47.513634 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18ce159-2161-43fb-9864-d6b934125a08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:48:47.514736 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab0f4fe-1863-4318-b417-74e84eef0022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5e0cb75b5f34491a7e94518c7bcdb03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:48:47.515416 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab0f4fe-1863-4318-b417-74e84eef0022 admin admin] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:48:47.515580 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18ce159-2161-43fb-9864-d6b934125a08 admin admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:48:47.515723 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab0f4fe-1863-4318-b417-74e84eef0022 admin admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:48:47.515985 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab0f4fe-1863-4318-b417-74e84eef0022 admin admin] PATH_INFO: `/v3/users` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:48:47.516686 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab0f4fe-1863-4318-b417-74e84eef0022 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:48:47.518636 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab0f4fe-1863-4318-b417-74e84eef0022 admin admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:48:47.544562 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 592/1180] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jul 15 20:48:47 2022] POST /identity/v3/users => generated 298 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:48:47.548901 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab0f4fe-1863-4318-b417-74e84eef0022 admin admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:48:47.556949 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 589/1181] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jul 15 20:48:47 2022] POST /identity/v3/projects => generated 379 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:48:47.558234 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18ce159-2161-43fb-9864-d6b934125a08 admin admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:48:47.559850 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab0f4fe-1863-4318-b417-74e84eef0022 admin admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:48:47.626765 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11a7ca4-cdea-4a57-88e8-82ef930b2304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5e0cb75b5f34491a7e94518c7bcdb03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:48:47.627458 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11a7ca4-cdea-4a57-88e8-82ef930b2304 admin admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:48:47.627836 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11a7ca4-cdea-4a57-88e8-82ef930b2304 admin admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:48:47.628083 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11a7ca4-cdea-4a57-88e8-82ef930b2304 admin admin] PATH_INFO: `/v3/roles` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:48:47.628762 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11a7ca4-cdea-4a57-88e8-82ef930b2304 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:48:47.630542 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11a7ca4-cdea-4a57-88e8-82ef930b2304 admin admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:48:47.638966 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18ce159-2161-43fb-9864-d6b934125a08 admin admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:48:47.642435 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 593/1182] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jul 15 20:48:47 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 20:48:47.644898 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4384b7-9d1f-462c-889b-37bcc003a075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5e0cb75b5f34491a7e94518c7bcdb03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:48:47.645943 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4384b7-9d1f-462c-889b-37bcc003a075 admin admin] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:48:47.646354 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4384b7-9d1f-462c-889b-37bcc003a075 admin admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:48:47.646509 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11a7ca4-cdea-4a57-88e8-82ef930b2304 admin admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:48:47.646745 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4384b7-9d1f-462c-889b-37bcc003a075 admin admin] PATH_INFO: `/v3/users` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:48:47.647510 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4384b7-9d1f-462c-889b-37bcc003a075 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:48:47.650293 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4384b7-9d1f-462c-889b-37bcc003a075 admin admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:48:47.657543 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11a7ca4-cdea-4a57-88e8-82ef930b2304 admin admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:48:47.663387 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6420f0a-888c-4338-bf2a-82ebbcedd633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5e0cb75b5f34491a7e94518c7bcdb03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:48:47.664375 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6420f0a-888c-4338-bf2a-82ebbcedd633 admin admin] REQUEST_METHOD: `PUT` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:48:47.664716 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6420f0a-888c-4338-bf2a-82ebbcedd633 admin admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:48:47.665024 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6420f0a-888c-4338-bf2a-82ebbcedd633 admin admin] PATH_INFO: `/v3/projects/59660395860545f8a06f32256f6a0440/users/f5501ab17eaf41b4ba611499953033b5/roles/cbcae224848142ce888ca5b84abfd18e` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:48:47.685293 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6420f0a-888c-4338-bf2a-82ebbcedd633 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59660395860545f8a06f32256f6a0440, user_id=f5501ab17eaf41b4ba611499953033b5, role_id=cbcae224848142ce888ca5b84abfd18e)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:48:47.688844 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 590/1183] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jul 15 20:48:47 2022] POST /identity/v3/users => generated 296 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:48:47.689000 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6420f0a-888c-4338-bf2a-82ebbcedd633 admin admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:48:47.690189 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4384b7-9d1f-462c-889b-37bcc003a075 admin admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:48:47.701432 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4384b7-9d1f-462c-889b-37bcc003a075 admin admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:48:47.704456 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 594/1184] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jul 15 20:48:47 2022] PUT /identity/v3/projects/59660395860545f8a06f32256f6a0440/users/f5501ab17eaf41b4ba611499953033b5/roles/cbcae224848142ce888ca5b84abfd18e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 20:48:47.708373 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6420f0a-888c-4338-bf2a-82ebbcedd633 admin admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:48:47.763180 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:48:47.770959 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5a4516-e535-4218-80cf-0ddcf4f5e7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5e0cb75b5f34491a7e94518c7bcdb03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:48:47.771864 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a4516-e535-4218-80cf-0ddcf4f5e7b2 admin admin] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:48:47.772194 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a4516-e535-4218-80cf-0ddcf4f5e7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:48:47.772547 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a4516-e535-4218-80cf-0ddcf4f5e7b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:48:47.773536 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5a4516-e535-4218-80cf-0ddcf4f5e7b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:48:47.775556 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5a4516-e535-4218-80cf-0ddcf4f5e7b2 admin admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:48:47.776723 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6420f0a-888c-4338-bf2a-82ebbcedd633 admin admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:48:47.781539 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1884e28b-d472-4976-b9d5-478e99508707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5e0cb75b5f34491a7e94518c7bcdb03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:48:47.782276 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1884e28b-d472-4976-b9d5-478e99508707 admin admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:48:47.782570 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1884e28b-d472-4976-b9d5-478e99508707 admin admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:48:47.782848 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1884e28b-d472-4976-b9d5-478e99508707 admin admin] PATH_INFO: `/v3/roles` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:48:47.783609 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1884e28b-d472-4976-b9d5-478e99508707 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:48:47.785195 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1884e28b-d472-4976-b9d5-478e99508707 admin admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:48:47.793531 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 591/1185] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jul 15 20:48:47 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 20:48:47.794521 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5a4516-e535-4218-80cf-0ddcf4f5e7b2 admin admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:48:47.802021 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 595/1186] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jul 15 20:48:47 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:48:47.803035 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1884e28b-d472-4976-b9d5-478e99508707 admin admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:48:47.808265 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5a4516-e535-4218-80cf-0ddcf4f5e7b2 admin admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:48:47.814724 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816bc905-5381-4288-ac69-a313de463512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5e0cb75b5f34491a7e94518c7bcdb03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:48:47.815455 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1884e28b-d472-4976-b9d5-478e99508707 admin admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:48:47.815775 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816bc905-5381-4288-ac69-a313de463512 admin admin] REQUEST_METHOD: `PUT` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:48:47.816133 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816bc905-5381-4288-ac69-a313de463512 admin admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:48:47.816484 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816bc905-5381-4288-ac69-a313de463512 admin admin] PATH_INFO: `/v3/projects/d63ba6eb7dab46a3bbac9d309927d073/users/886ca46645bf4da1bfb68c8bf77f89e6/roles/cbcae224848142ce888ca5b84abfd18e` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:48:47.821393 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79a8567-f03a-4e0c-a9bd-83cea1ad8928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5e0cb75b5f34491a7e94518c7bcdb03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:48:47.822976 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a8567-f03a-4e0c-a9bd-83cea1ad8928 admin admin] REQUEST_METHOD: `PUT` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:48:47.823335 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a8567-f03a-4e0c-a9bd-83cea1ad8928 admin admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:48:47.823687 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a8567-f03a-4e0c-a9bd-83cea1ad8928 admin admin] PATH_INFO: `/v3/projects/59660395860545f8a06f32256f6a0440/users/f5501ab17eaf41b4ba611499953033b5/roles/cbcae224848142ce888ca5b84abfd18e` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:48:47.826123 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79a8567-f03a-4e0c-a9bd-83cea1ad8928 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59660395860545f8a06f32256f6a0440, user_id=f5501ab17eaf41b4ba611499953033b5, role_id=cbcae224848142ce888ca5b84abfd18e)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:48:47.829197 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79a8567-f03a-4e0c-a9bd-83cea1ad8928 admin admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:48:47.837446 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:48:47.838519 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816bc905-5381-4288-ac69-a313de463512 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d63ba6eb7dab46a3bbac9d309927d073, user_id=886ca46645bf4da1bfb68c8bf77f89e6, role_id=cbcae224848142ce888ca5b84abfd18e)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:48:47.841670 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816bc905-5381-4288-ac69-a313de463512 admin admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:48:47.842901 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 596/1187] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jul 15 20:48:47 2022] PUT /identity/v3/projects/59660395860545f8a06f32256f6a0440/users/f5501ab17eaf41b4ba611499953033b5/roles/cbcae224848142ce888ca5b84abfd18e => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:48:47.861910 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 592/1188] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jul 15 20:48:47 2022] PUT /identity/v3/projects/d63ba6eb7dab46a3bbac9d309927d073/users/886ca46645bf4da1bfb68c8bf77f89e6/roles/cbcae224848142ce888ca5b84abfd18e => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:48:47.862945 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79a8567-f03a-4e0c-a9bd-83cea1ad8928 admin admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:48:47.933491 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79a8567-f03a-4e0c-a9bd-83cea1ad8928 admin admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:48:48.006623 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28ea461-1e90-4770-ab15-e02199b93530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5e0cb75b5f34491a7e94518c7bcdb03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:48:48.007307 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ea461-1e90-4770-ab15-e02199b93530 admin admin] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:48:48.007666 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ea461-1e90-4770-ab15-e02199b93530 admin admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:48:48.007907 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ea461-1e90-4770-ab15-e02199b93530 admin admin] PATH_INFO: `/v3/roles` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:48:48.008644 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28ea461-1e90-4770-ab15-e02199b93530 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:48:48.010963 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28ea461-1e90-4770-ab15-e02199b93530 admin admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:48:48.024549 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 597/1189] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jul 15 20:48:47 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 20:48:48.026232 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816bc905-5381-4288-ac69-a313de463512 admin admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:48:48.036929 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816bc905-5381-4288-ac69-a313de463512 admin admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:48:48.043065 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1681337b-8c61-43cb-abb1-aa38f460a850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5e0cb75b5f34491a7e94518c7bcdb03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:48:48.044140 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1681337b-8c61-43cb-abb1-aa38f460a850 admin admin] REQUEST_METHOD: `PUT` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:48:48.044431 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1681337b-8c61-43cb-abb1-aa38f460a850 admin admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:48:48.044719 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1681337b-8c61-43cb-abb1-aa38f460a850 admin admin] PATH_INFO: `/v3/projects/d63ba6eb7dab46a3bbac9d309927d073/users/886ca46645bf4da1bfb68c8bf77f89e6/roles/cbcae224848142ce888ca5b84abfd18e` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:48:48.046783 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1681337b-8c61-43cb-abb1-aa38f460a850 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d63ba6eb7dab46a3bbac9d309927d073, user_id=886ca46645bf4da1bfb68c8bf77f89e6, role_id=cbcae224848142ce888ca5b84abfd18e)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:48:48.049446 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1681337b-8c61-43cb-abb1-aa38f460a850 admin admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:48:48.064421 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 593/1190] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jul 15 20:48:48 2022] PUT /identity/v3/projects/d63ba6eb7dab46a3bbac9d309927d073/users/886ca46645bf4da1bfb68c8bf77f89e6/roles/cbcae224848142ce888ca5b84abfd18e => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 20:48:54.347029 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d768db3d-30d0-4194-aa18-0cb5320d9848 None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:48:54.347550 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d768db3d-30d0-4194-aa18-0cb5320d9848 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:48:54.347659 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d768db3d-30d0-4194-aa18-0cb5320d9848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:48:54.398526 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-d768db3d-30d0-4194-aa18-0cb5320d9848 None None] MFA Rules not processed for user `f5501ab17eaf41b4ba611499953033b5`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:48:54.399867 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-d768db3d-30d0-4194-aa18-0cb5320d9848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:48:54.541768 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 598/1191] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jul 15 20:48:54 2022] POST /identity/v3/auth/tokens => generated 2877 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:48:54.558562 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1681337b-8c61-43cb-abb1-aa38f460a850 admin admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:48:54.561045 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-1681337b-8c61-43cb-abb1-aa38f460a850 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:48:54.724393 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1681337b-8c61-43cb-abb1-aa38f460a850 admin admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:48:54.729940 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de86493d-580a-4fcf-b2ee-1f2fd3555f8d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2766cf20921045a896ff7735cc2534d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:48:54.731060 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de86493d-580a-4fcf-b2ee-1f2fd3555f8d service glance] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:48:54.731915 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de86493d-580a-4fcf-b2ee-1f2fd3555f8d service glance] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:48:54.732430 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de86493d-580a-4fcf-b2ee-1f2fd3555f8d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:48:54.824054 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de86493d-580a-4fcf-b2ee-1f2fd3555f8d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:48:54.826104 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de86493d-580a-4fcf-b2ee-1f2fd3555f8d service glance] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:48:54.838015 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 594/1192] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:48:54 2022] GET /identity/v3/auth/tokens => generated 2810 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:48:54.931013 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e3465-bcf0-4267-a8f8-7245616c4279 None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:48:54.931444 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e3465-bcf0-4267-a8f8-7245616c4279 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:48:54.932092 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e3465-bcf0-4267-a8f8-7245616c4279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:48:54.970887 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-eb9e3465-bcf0-4267-a8f8-7245616c4279 None None] MFA Rules not processed for user `886ca46645bf4da1bfb68c8bf77f89e6`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:48:54.972422 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-eb9e3465-bcf0-4267-a8f8-7245616c4279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:48:54.998369 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:48:55.114526 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 599/1193] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jul 15 20:48:54 2022] POST /identity/v3/auth/tokens => generated 2873 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:48:55.130841 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de86493d-580a-4fcf-b2ee-1f2fd3555f8d service glance] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:48:55.140791 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de86493d-580a-4fcf-b2ee-1f2fd3555f8d service glance] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:48:55.160729 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf6e09-2714-460e-aceb-877c233f2375 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2766cf20921045a896ff7735cc2534d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:48:55.160729 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf6e09-2714-460e-aceb-877c233f2375 service glance] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:48:55.160729 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf6e09-2714-460e-aceb-877c233f2375 service glance] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:48:55.161037 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf6e09-2714-460e-aceb-877c233f2375 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:48:55.275179 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:48:55.279801 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bf6e09-2714-460e-aceb-877c233f2375 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:48:55.281743 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bf6e09-2714-460e-aceb-877c233f2375 service glance] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:48:55.304647 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 595/1194] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:48:55 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:49:03.262680 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9741b-fdc8-40b8-8ef3-deb14b28cfbc None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:49:03.263274 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9741b-fdc8-40b8-8ef3-deb14b28cfbc None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:49:03.263586 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9741b-fdc8-40b8-8ef3-deb14b28cfbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:49:03.287715 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-1bd9741b-fdc8-40b8-8ef3-deb14b28cfbc None None] MFA Rules not processed for user `f7dea4f74fa9403aba00ece617f77b89`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:49:03.289024 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-1bd9741b-fdc8-40b8-8ef3-deb14b28cfbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:49:03.301147 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 600/1195] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jul 15 20:49:03 2022] POST /identity/v3/auth/tokens => generated 2810 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:49:03.621190 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e625da00-612f-4cf5-bfed-86a237d15491 None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:49:03.621712 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e625da00-612f-4cf5-bfed-86a237d15491 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:49:03.621836 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e625da00-612f-4cf5-bfed-86a237d15491 None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:49:03.623225 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 596/1196] 10.222.0.16 () {54 vars in 961 bytes} [Fri Jul 15 20:49:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:49:03.628414 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97763f72-ba38-41ee-85d0-9b719102df59 None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:49:03.628707 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97763f72-ba38-41ee-85d0-9b719102df59 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:49:03.628988 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97763f72-ba38-41ee-85d0-9b719102df59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:49:03.660066 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-97763f72-ba38-41ee-85d0-9b719102df59 None None] MFA Rules not processed for user `b3e5296637584004b1888453ab9056c4`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:49:03.661349 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-97763f72-ba38-41ee-85d0-9b719102df59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:49:03.726600 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 601/1197] 10.222.0.16 () {58 vars in 1058 bytes} [Fri Jul 15 20:49:03 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 20:49:03.732616 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b15e557-fb10-4457-8583-2db815d6a1b0 None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:49:03.732923 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b15e557-fb10-4457-8583-2db815d6a1b0 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:49:03.733197 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b15e557-fb10-4457-8583-2db815d6a1b0 None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:49:03.734582 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 597/1198] 10.222.0.16 () {54 vars in 912 bytes} [Fri Jul 15 20:49:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:49:03.739446 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1391bb4-19e9-48e2-ac70-94bdfc474cc8 None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:49:03.739742 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1391bb4-19e9-48e2-ac70-94bdfc474cc8 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:49:03.740027 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1391bb4-19e9-48e2-ac70-94bdfc474cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:49:03.757769 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-b1391bb4-19e9-48e2-ac70-94bdfc474cc8 None None] MFA Rules not processed for user `b3e5296637584004b1888453ab9056c4`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:49:03.759080 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-b1391bb4-19e9-48e2-ac70-94bdfc474cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:49:03.767829 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 602/1199] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Jul 15 20:49:03 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:49:03.779659 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b15e557-fb10-4457-8583-2db815d6a1b0 None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:49:03.781330 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-6b15e557-fb10-4457-8583-2db815d6a1b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:49:03.795471 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b15e557-fb10-4457-8583-2db815d6a1b0 None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:49:03.799021 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac03dfa9-6c37-4f20-8e2a-de63d3abbb58 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2766cf20921045a896ff7735cc2534d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:49:03.799671 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac03dfa9-6c37-4f20-8e2a-de63d3abbb58 service glance] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:49:03.799962 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac03dfa9-6c37-4f20-8e2a-de63d3abbb58 service glance] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:49:03.800508 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac03dfa9-6c37-4f20-8e2a-de63d3abbb58 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:49:03.810162 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac03dfa9-6c37-4f20-8e2a-de63d3abbb58 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:49:03.811722 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac03dfa9-6c37-4f20-8e2a-de63d3abbb58 service glance] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:49:03.822463 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 598/1200] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:49:03 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:49:04.171122 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4972cb-4abf-4f6c-b9fb-216e1c261903 None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:49:04.171509 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4972cb-4abf-4f6c-b9fb-216e1c261903 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:49:04.171881 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4972cb-4abf-4f6c-b9fb-216e1c261903 None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:49:04.173311 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 603/1201] 10.222.0.16 () {54 vars in 912 bytes} [Fri Jul 15 20:49:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 20:49:04.179415 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150275ff-466e-4938-87eb-6e87370dc0bb None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:49:04.179913 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150275ff-466e-4938-87eb-6e87370dc0bb None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:49:04.180364 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150275ff-466e-4938-87eb-6e87370dc0bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:49:04.225396 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-150275ff-466e-4938-87eb-6e87370dc0bb None None] MFA Rules not processed for user `3491680e892041678242f9b93617b9a6`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:49:04.226778 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-150275ff-466e-4938-87eb-6e87370dc0bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:49:04.279284 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 599/1202] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Jul 15 20:49:04 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:49:04.290528 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4972cb-4abf-4f6c-b9fb-216e1c261903 None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:49:04.302113 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4972cb-4abf-4f6c-b9fb-216e1c261903 None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:49:04.306543 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4422d8e3-6336-4d31-971a-0537a6752627 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3491680e892041678242f9b93617b9a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:49:04.308669 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422d8e3-6336-4d31-971a-0537a6752627 service neutron] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:49:04.308951 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422d8e3-6336-4d31-971a-0537a6752627 service neutron] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:49:04.309226 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422d8e3-6336-4d31-971a-0537a6752627 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:49:04.317490 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4422d8e3-6336-4d31-971a-0537a6752627 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:49:04.318998 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4422d8e3-6336-4d31-971a-0537a6752627 service neutron] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:49:04.328930 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 604/1203] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:49:04 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:49:04.745461 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4de0188-e2bc-4243-9640-6ab215905a76 None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:49:04.745876 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4de0188-e2bc-4243-9640-6ab215905a76 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:49:04.746034 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4de0188-e2bc-4243-9640-6ab215905a76 None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:49:04.747448 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 600/1204] 10.222.0.16 () {54 vars in 961 bytes} [Fri Jul 15 20:49:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:49:04.750773 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0361e29c-81c8-4966-98a4-07577bff4192 None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:49:04.751138 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0361e29c-81c8-4966-98a4-07577bff4192 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:49:04.751500 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0361e29c-81c8-4966-98a4-07577bff4192 None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:49:04.753390 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 605/1205] 10.222.0.16 () {54 vars in 960 bytes} [Fri Jul 15 20:49:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 20:49:04.753526 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719418a2-36bf-467f-9f17-272a2f588273 None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:49:04.753773 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719418a2-36bf-467f-9f17-272a2f588273 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:49:04.754063 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719418a2-36bf-467f-9f17-272a2f588273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:49:04.758984 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e708c64-0918-4d8c-8a23-e9d7296e0340 None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:49:04.759271 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e708c64-0918-4d8c-8a23-e9d7296e0340 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:49:04.759559 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e708c64-0918-4d8c-8a23-e9d7296e0340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:49:04.774409 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-719418a2-36bf-467f-9f17-272a2f588273 None None] MFA Rules not processed for user `b3e5296637584004b1888453ab9056c4`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:49:04.775753 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-719418a2-36bf-467f-9f17-272a2f588273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:49:04.780930 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-5e708c64-0918-4d8c-8a23-e9d7296e0340 None None] MFA Rules not processed for user `913ad55c6c7b4c41ac22dd0a93ef656c`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:49:04.782144 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-5e708c64-0918-4d8c-8a23-e9d7296e0340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:49:04.786542 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 601/1206] 10.222.0.16 () {58 vars in 1058 bytes} [Fri Jul 15 20:49:04 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 20:49:04.792454 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f8f18c-246e-4026-b72a-6a5c85468837 None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:49:04.792752 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f8f18c-246e-4026-b72a-6a5c85468837 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:49:04.793033 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f8f18c-246e-4026-b72a-6a5c85468837 None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:49:04.794420 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 602/1207] 10.222.0.16 () {54 vars in 912 bytes} [Fri Jul 15 20:49:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 20:49:04.799633 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e350dba-7257-468c-a7b7-ebc75a0d21a7 None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:49:04.799928 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e350dba-7257-468c-a7b7-ebc75a0d21a7 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:49:04.800216 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e350dba-7257-468c-a7b7-ebc75a0d21a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:49:04.818984 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-0e350dba-7257-468c-a7b7-ebc75a0d21a7 None None] MFA Rules not processed for user `b3e5296637584004b1888453ab9056c4`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:49:04.820192 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-0e350dba-7257-468c-a7b7-ebc75a0d21a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:49:04.831399 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 603/1208] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Jul 15 20:49:04 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:49:04.843266 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e350dba-7257-468c-a7b7-ebc75a0d21a7 None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:49:04.853880 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e350dba-7257-468c-a7b7-ebc75a0d21a7 None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:49:04.854994 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 606/1209] 10.222.0.16 () {58 vars in 1057 bytes} [Fri Jul 15 20:49:04 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 20:49:04.859089 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abed318e-502b-4f92-81f6-a48ef2197eda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3491680e892041678242f9b93617b9a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:49:04.859820 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed318e-502b-4f92-81f6-a48ef2197eda service neutron] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:49:04.860111 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed318e-502b-4f92-81f6-a48ef2197eda service neutron] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:49:04.860400 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed318e-502b-4f92-81f6-a48ef2197eda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:49:04.862047 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e708c64-0918-4d8c-8a23-e9d7296e0340 None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:49:04.871799 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abed318e-502b-4f92-81f6-a48ef2197eda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:49:04.873249 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abed318e-502b-4f92-81f6-a48ef2197eda service neutron] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:49:04.873364 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e708c64-0918-4d8c-8a23-e9d7296e0340 None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:49:04.878791 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c10368b-a567-48a4-9d56-5ccc403603d1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913ad55c6c7b4c41ac22dd0a93ef656c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:49:04.879804 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c10368b-a567-48a4-9d56-5ccc403603d1 service placement] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:49:04.879804 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c10368b-a567-48a4-9d56-5ccc403603d1 service placement] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:49:04.880027 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c10368b-a567-48a4-9d56-5ccc403603d1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:49:04.882358 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-4c10368b-a567-48a4-9d56-5ccc403603d1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:49:04.885319 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 604/1210] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:49:04 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 20:49:04.893129 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=100 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:49:04.896697 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c10368b-a567-48a4-9d56-5ccc403603d1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:49:04.898886 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c10368b-a567-48a4-9d56-5ccc403603d1 service placement] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:49:04.909622 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 607/1211] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:49:04 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 20:49:14.880892 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=48 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:49:14.905749 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=2 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:49:15.393280 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15f3f36-a6af-48f8-833c-79eb8cc9376a None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:49:15.393635 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15f3f36-a6af-48f8-833c-79eb8cc9376a None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:49:15.393930 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15f3f36-a6af-48f8-833c-79eb8cc9376a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:49:15.413337 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-e15f3f36-a6af-48f8-833c-79eb8cc9376a None None] MFA Rules not processed for user `3491680e892041678242f9b93617b9a6`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:49:15.415104 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-e15f3f36-a6af-48f8-833c-79eb8cc9376a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:49:15.421574 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 605/1212] 10.222.0.59 () {58 vars in 1015 bytes} [Fri Jul 15 20:49:15 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:49:15.436670 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c10368b-a567-48a4-9d56-5ccc403603d1 service placement] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:49:15.446473 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c10368b-a567-48a4-9d56-5ccc403603d1 service placement] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:49:15.450065 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940d4c88-e1b9-45b0-81fe-e17a3e578126 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3491680e892041678242f9b93617b9a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:49:15.451038 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d4c88-e1b9-45b0-81fe-e17a3e578126 service neutron] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:49:15.451332 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d4c88-e1b9-45b0-81fe-e17a3e578126 service neutron] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:49:15.451606 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d4c88-e1b9-45b0-81fe-e17a3e578126 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:49:15.462015 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940d4c88-e1b9-45b0-81fe-e17a3e578126 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:49:15.463487 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940d4c88-e1b9-45b0-81fe-e17a3e578126 service neutron] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:49:15.472816 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 608/1213] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:49:15 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:49:16.514319 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bdff19-3e81-43ee-aa6e-d42d585b5d1f None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:49:16.515842 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bdff19-3e81-43ee-aa6e-d42d585b5d1f None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:49:16.516317 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bdff19-3e81-43ee-aa6e-d42d585b5d1f None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:49:16.519368 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 606/1214] 10.222.0.16 () {54 vars in 921 bytes} [Fri Jul 15 20:49:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:49:16.577726 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db68ca4-bcaa-4a1d-8c4c-f4087feb9e92 None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:49:16.578383 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db68ca4-bcaa-4a1d-8c4c-f4087feb9e92 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:49:16.580819 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db68ca4-bcaa-4a1d-8c4c-f4087feb9e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:49:16.613451 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-9db68ca4-bcaa-4a1d-8c4c-f4087feb9e92 None None] MFA Rules not processed for user `b3e5296637584004b1888453ab9056c4`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:49:16.614935 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-9db68ca4-bcaa-4a1d-8c4c-f4087feb9e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:49:16.627204 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 609/1215] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Jul 15 20:49:16 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:49:16.682801 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bdff19-3e81-43ee-aa6e-d42d585b5d1f None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:49:16.696849 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bdff19-3e81-43ee-aa6e-d42d585b5d1f None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:49:16.702713 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333a0547-e0aa-4f0c-a2c7-6cfc117e5701 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e5296637584004b1888453ab9056c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:49:16.703289 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a0547-e0aa-4f0c-a2c7-6cfc117e5701 service nova] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:49:16.703579 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a0547-e0aa-4f0c-a2c7-6cfc117e5701 service nova] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:49:16.703861 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a0547-e0aa-4f0c-a2c7-6cfc117e5701 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:49:16.714159 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333a0547-e0aa-4f0c-a2c7-6cfc117e5701 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:49:16.717329 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333a0547-e0aa-4f0c-a2c7-6cfc117e5701 service nova] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:49:16.744632 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 607/1216] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:49:16 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:49:22.373509 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe5a95-9cd5-4659-81de-c33dc08e92ff None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:49:22.374512 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe5a95-9cd5-4659-81de-c33dc08e92ff None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:49:22.374809 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe5a95-9cd5-4659-81de-c33dc08e92ff None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:49:22.376907 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 610/1217] 10.222.0.16 () {54 vars in 921 bytes} [Fri Jul 15 20:49:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:49:22.382877 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6081af-e2ee-45d0-9799-f6db0b94ddd4 None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:49:22.384391 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6081af-e2ee-45d0-9799-f6db0b94ddd4 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:49:22.385860 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6081af-e2ee-45d0-9799-f6db0b94ddd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:49:22.406442 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-6b6081af-e2ee-45d0-9799-f6db0b94ddd4 None None] MFA Rules not processed for user `b3e5296637584004b1888453ab9056c4`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:49:22.407687 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-6b6081af-e2ee-45d0-9799-f6db0b94ddd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:49:22.417236 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 608/1218] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Jul 15 20:49:22 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:49:22.503990 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fe5a95-9cd5-4659-81de-c33dc08e92ff None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:49:22.519436 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fe5a95-9cd5-4659-81de-c33dc08e92ff None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:49:22.524527 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab67aa88-35cd-4e89-8262-3a8072d485cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e5296637584004b1888453ab9056c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:49:22.525535 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67aa88-35cd-4e89-8262-3a8072d485cb service nova] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:49:22.525535 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67aa88-35cd-4e89-8262-3a8072d485cb service nova] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:49:22.525749 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67aa88-35cd-4e89-8262-3a8072d485cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:49:22.535788 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab67aa88-35cd-4e89-8262-3a8072d485cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:49:22.537663 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab67aa88-35cd-4e89-8262-3a8072d485cb service nova] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:49:22.548977 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 611/1219] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:49:22 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:49:32.401023 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=12 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:49:32.544388 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=15 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:49:36.413993 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6081af-e2ee-45d0-9799-f6db0b94ddd4 None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:49:36.424809 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6081af-e2ee-45d0-9799-f6db0b94ddd4 None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:49:36.428281 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3575b005-2254-43f9-b69f-2fa1d2f1b758 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3491680e892041678242f9b93617b9a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:49:36.428933 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3575b005-2254-43f9-b69f-2fa1d2f1b758 service neutron] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:49:36.429218 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3575b005-2254-43f9-b69f-2fa1d2f1b758 service neutron] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:49:36.429497 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3575b005-2254-43f9-b69f-2fa1d2f1b758 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:49:36.441015 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3575b005-2254-43f9-b69f-2fa1d2f1b758 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:49:36.443501 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3575b005-2254-43f9-b69f-2fa1d2f1b758 service neutron] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:49:36.465354 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 609/1220] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:49:36 2022] GET /identity/v3/auth/tokens => generated 2877 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:49:46.452821 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=6 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:49:57.309052 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019bf248-7e5d-472c-8198-e50bde81073e None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:49:57.309631 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019bf248-7e5d-472c-8198-e50bde81073e None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:49:57.309631 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019bf248-7e5d-472c-8198-e50bde81073e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:49:57.326860 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-019bf248-7e5d-472c-8198-e50bde81073e None None] MFA Rules not processed for user `a9778171a01b491b800c5fe175f27086`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:49:57.328057 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-019bf248-7e5d-472c-8198-e50bde81073e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:49:57.334860 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 612/1221] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jul 15 20:49:57 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:49:57.651781 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a01d9e-dcc2-4065-85ef-2007d3767efb None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:49:57.652311 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a01d9e-dcc2-4065-85ef-2007d3767efb None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:49:57.652418 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a01d9e-dcc2-4065-85ef-2007d3767efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:49:57.670848 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-13a01d9e-dcc2-4065-85ef-2007d3767efb None None] MFA Rules not processed for user `3491680e892041678242f9b93617b9a6`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:49:57.672039 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-13a01d9e-dcc2-4065-85ef-2007d3767efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:49:57.678811 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 610/1222] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Jul 15 20:49:57 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:49:57.689998 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019bf248-7e5d-472c-8198-e50bde81073e None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:49:57.699354 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019bf248-7e5d-472c-8198-e50bde81073e None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:49:57.703178 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9319a3c4-e072-4299-a8c5-4bcee180f539 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3491680e892041678242f9b93617b9a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:49:57.703807 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9319a3c4-e072-4299-a8c5-4bcee180f539 service neutron] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:49:57.704096 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9319a3c4-e072-4299-a8c5-4bcee180f539 service neutron] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:49:57.704370 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9319a3c4-e072-4299-a8c5-4bcee180f539 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:49:57.711311 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9319a3c4-e072-4299-a8c5-4bcee180f539 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:49:57.712728 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9319a3c4-e072-4299-a8c5-4bcee180f539 service neutron] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:49:57.720831 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 613/1223] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:49:57 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 20:50:07.664898 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=3 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:50:07.717496 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=9 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:50:20.520499 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b9820d-ce07-437d-ba28-5da4e28064aa None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:50:20.521088 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b9820d-ce07-437d-ba28-5da4e28064aa None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:50:20.521088 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b9820d-ce07-437d-ba28-5da4e28064aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:50:20.538832 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-24b9820d-ce07-437d-ba28-5da4e28064aa None None] MFA Rules not processed for user `a9778171a01b491b800c5fe175f27086`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:50:20.540027 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-24b9820d-ce07-437d-ba28-5da4e28064aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:50:20.547167 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 611/1224] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jul 15 20:50:20 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:50:30.533674 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=3 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:50:35.152499 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c7817b-a75e-4812-8366-fae269ac73ac None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:50:35.153481 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c7817b-a75e-4812-8366-fae269ac73ac None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:50:35.153575 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c7817b-a75e-4812-8366-fae269ac73ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:50:35.171399 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-b0c7817b-a75e-4812-8366-fae269ac73ac None None] MFA Rules not processed for user `a9778171a01b491b800c5fe175f27086`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:50:35.172587 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-b0c7817b-a75e-4812-8366-fae269ac73ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:50:35.179570 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 614/1225] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jul 15 20:50:35 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:50:45.165759 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=3 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:51:33.888790 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fffb23-2908-478a-b1fa-dc23386f56c6 None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:51:33.889280 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fffb23-2908-478a-b1fa-dc23386f56c6 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:51:33.889371 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fffb23-2908-478a-b1fa-dc23386f56c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:51:33.906269 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-e6fffb23-2908-478a-b1fa-dc23386f56c6 None None] MFA Rules not processed for user `a9778171a01b491b800c5fe175f27086`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:51:33.907476 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-e6fffb23-2908-478a-b1fa-dc23386f56c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:51:33.914679 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 612/1226] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jul 15 20:51:33 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:51:43.901369 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=3 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:51:45.708328 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c7817b-a75e-4812-8366-fae269ac73ac None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:51:45.727656 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c7817b-a75e-4812-8366-fae269ac73ac None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:51:45.731196 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdc1e06-1f36-4ce6-b22e-8c47970700b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3491680e892041678242f9b93617b9a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:51:45.731840 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdc1e06-1f36-4ce6-b22e-8c47970700b2 service neutron] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:51:45.732129 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdc1e06-1f36-4ce6-b22e-8c47970700b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:51:45.732410 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdc1e06-1f36-4ce6-b22e-8c47970700b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:51:45.741229 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdc1e06-1f36-4ce6-b22e-8c47970700b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:51:45.742707 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdc1e06-1f36-4ce6-b22e-8c47970700b2 service neutron] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:51:45.752014 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 615/1227] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:51:45 2022] GET /identity/v3/auth/tokens => generated 2873 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:51:55.747992 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=10 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:53:03.332863 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fffb23-2908-478a-b1fa-dc23386f56c6 None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:53:03.355049 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fffb23-2908-478a-b1fa-dc23386f56c6 None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:53:03.360097 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffa19d5-e734-4431-a109-701667b1914b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913ad55c6c7b4c41ac22dd0a93ef656c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:53:03.360748 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffa19d5-e734-4431-a109-701667b1914b service placement] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:53:03.361040 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffa19d5-e734-4431-a109-701667b1914b service placement] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:53:03.361326 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffa19d5-e734-4431-a109-701667b1914b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:53:03.370314 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffa19d5-e734-4431-a109-701667b1914b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:53:03.371864 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffa19d5-e734-4431-a109-701667b1914b service placement] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:53:03.381479 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 613/1228] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:53:03 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:53:13.377491 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=10 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:53:35.276724 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce49588-9867-4269-a719-7377ebbbd0a2 None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:53:35.277206 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce49588-9867-4269-a719-7377ebbbd0a2 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:53:35.277297 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce49588-9867-4269-a719-7377ebbbd0a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:53:35.294511 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-3ce49588-9867-4269-a719-7377ebbbd0a2 None None] MFA Rules not processed for user `f7dea4f74fa9403aba00ece617f77b89`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:53:35.295712 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-3ce49588-9867-4269-a719-7377ebbbd0a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:53:35.302590 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 616/1229] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jul 15 20:53:35 2022] POST /identity/v3/auth/tokens => generated 2810 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:53:45.289741 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=3 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:53:54.768507 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffa19d5-e734-4431-a109-701667b1914b service placement] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:53:54.789519 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffa19d5-e734-4431-a109-701667b1914b service placement] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:53:54.794519 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6bf4f0-9584-4638-bcd7-b670f32ed6d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e5296637584004b1888453ab9056c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:53:54.795163 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6bf4f0-9584-4638-bcd7-b670f32ed6d8 service nova] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:53:54.795448 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6bf4f0-9584-4638-bcd7-b670f32ed6d8 service nova] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:53:54.795725 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6bf4f0-9584-4638-bcd7-b670f32ed6d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:53:54.803889 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6bf4f0-9584-4638-bcd7-b670f32ed6d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:53:54.805501 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6bf4f0-9584-4638-bcd7-b670f32ed6d8 service nova] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:53:54.814598 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 614/1230] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:53:54 2022] GET /identity/v3/auth/tokens => generated 2810 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:53:55.758850 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce49588-9867-4269-a719-7377ebbbd0a2 None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:53:55.776941 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce49588-9867-4269-a719-7377ebbbd0a2 None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:53:55.782826 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a8f00a-c2ff-4bb8-a5b0-1ab56f818602 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e5296637584004b1888453ab9056c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:53:55.783484 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a8f00a-c2ff-4bb8-a5b0-1ab56f818602 service nova] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:53:55.783775 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a8f00a-c2ff-4bb8-a5b0-1ab56f818602 service nova] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:53:55.784054 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a8f00a-c2ff-4bb8-a5b0-1ab56f818602 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:53:55.794336 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a8f00a-c2ff-4bb8-a5b0-1ab56f818602 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:53:55.795967 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a8f00a-c2ff-4bb8-a5b0-1ab56f818602 service nova] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:53:55.805700 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 617/1231] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:53:55 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:53:59.546720 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840d4564-ec49-4e88-9c0c-ba757da4768a None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:53:59.547622 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840d4564-ec49-4e88-9c0c-ba757da4768a None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:53:59.548308 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840d4564-ec49-4e88-9c0c-ba757da4768a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:53:59.580180 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-840d4564-ec49-4e88-9c0c-ba757da4768a None None] MFA Rules not processed for user `a9778171a01b491b800c5fe175f27086`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:53:59.582199 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-840d4564-ec49-4e88-9c0c-ba757da4768a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:53:59.594866 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 615/1232] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jul 15 20:53:59 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:54:04.680615 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a8f00a-c2ff-4bb8-a5b0-1ab56f818602 service nova] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:54:04.690442 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a8f00a-c2ff-4bb8-a5b0-1ab56f818602 service nova] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:54:04.693927 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4358f98-64b1-4b3d-9ab5-4a3c3b8c817e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3491680e892041678242f9b93617b9a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:54:04.694619 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4358f98-64b1-4b3d-9ab5-4a3c3b8c817e service neutron] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:54:04.694959 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4358f98-64b1-4b3d-9ab5-4a3c3b8c817e service neutron] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:54:04.695241 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4358f98-64b1-4b3d-9ab5-4a3c3b8c817e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:54:04.705254 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4358f98-64b1-4b3d-9ab5-4a3c3b8c817e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:54:04.707204 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4358f98-64b1-4b3d-9ab5-4a3c3b8c817e service neutron] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:54:04.718215 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 618/1233] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:54:04 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 20:54:05.322066 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840d4564-ec49-4e88-9c0c-ba757da4768a None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:54:05.333532 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840d4564-ec49-4e88-9c0c-ba757da4768a None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:54:05.338521 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48a9ff0-d58c-4692-bd0f-66f57f0d84c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3491680e892041678242f9b93617b9a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:54:05.339261 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a9ff0-d58c-4692-bd0f-66f57f0d84c2 service neutron] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:54:05.339618 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a9ff0-d58c-4692-bd0f-66f57f0d84c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:54:05.340004 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a9ff0-d58c-4692-bd0f-66f57f0d84c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:54:05.351163 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48a9ff0-d58c-4692-bd0f-66f57f0d84c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:54:05.352832 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48a9ff0-d58c-4692-bd0f-66f57f0d84c2 service neutron] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:54:05.365228 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 616/1234] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:54:05 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:54:13.800028 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a199d21f-e778-42b2-babe-3c9404eaea62 None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:54:13.800807 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a199d21f-e778-42b2-babe-3c9404eaea62 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:54:13.800807 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a199d21f-e778-42b2-babe-3c9404eaea62 None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:54:13.801955 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 619/1235] 10.222.0.16 () {54 vars in 921 bytes} [Fri Jul 15 20:54:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:54:13.807122 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9cb7ba-51cb-4429-8198-5ccc13d1bb15 None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:54:13.807577 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9cb7ba-51cb-4429-8198-5ccc13d1bb15 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:54:13.807764 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9cb7ba-51cb-4429-8198-5ccc13d1bb15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:54:13.858256 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-fb9cb7ba-51cb-4429-8198-5ccc13d1bb15 None None] MFA Rules not processed for user `b3e5296637584004b1888453ab9056c4`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:54:13.859471 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-fb9cb7ba-51cb-4429-8198-5ccc13d1bb15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:54:13.869287 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 617/1236] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Jul 15 20:54:13 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:54:13.881627 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a199d21f-e778-42b2-babe-3c9404eaea62 None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:54:13.895477 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a199d21f-e778-42b2-babe-3c9404eaea62 None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:54:13.901126 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7345c7b-9a60-4910-ae97-8f70c597f8ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e5296637584004b1888453ab9056c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:54:13.901782 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7345c7b-9a60-4910-ae97-8f70c597f8ff service nova] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:54:13.902089 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7345c7b-9a60-4910-ae97-8f70c597f8ff service nova] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:54:13.902388 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7345c7b-9a60-4910-ae97-8f70c597f8ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:54:13.911459 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7345c7b-9a60-4910-ae97-8f70c597f8ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:54:13.913051 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7345c7b-9a60-4910-ae97-8f70c597f8ff service nova] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:54:13.923956 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 620/1237] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:54:13 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 20:54:23.855252 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=32 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:54:23.919813 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=18 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:54:34.365503 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9cb7ba-51cb-4429-8198-5ccc13d1bb15 None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:54:34.375849 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9cb7ba-51cb-4429-8198-5ccc13d1bb15 None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:54:34.380050 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbfd59d-bdbf-4f29-8fc1-1961eea3af74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3491680e892041678242f9b93617b9a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:54:34.380781 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbfd59d-bdbf-4f29-8fc1-1961eea3af74 service neutron] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:54:34.381140 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbfd59d-bdbf-4f29-8fc1-1961eea3af74 service neutron] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:54:34.381638 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbfd59d-bdbf-4f29-8fc1-1961eea3af74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:54:34.389567 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbfd59d-bdbf-4f29-8fc1-1961eea3af74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:54:34.391221 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbfd59d-bdbf-4f29-8fc1-1961eea3af74 service neutron] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:54:34.399539 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 618/1238] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:54:34 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:54:44.396076 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=6 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:55:27.817501 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7345c7b-9a60-4910-ae97-8f70c597f8ff service nova] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:55:27.848465 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7345c7b-9a60-4910-ae97-8f70c597f8ff service nova] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:55:27.874810 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04114e50-a5c0-4e7f-9848-bae85a78e7db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e5296637584004b1888453ab9056c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:55:27.875496 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04114e50-a5c0-4e7f-9848-bae85a78e7db service nova] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:55:27.875788 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04114e50-a5c0-4e7f-9848-bae85a78e7db service nova] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:55:27.876061 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04114e50-a5c0-4e7f-9848-bae85a78e7db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:55:27.886682 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04114e50-a5c0-4e7f-9848-bae85a78e7db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:55:27.888304 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04114e50-a5c0-4e7f-9848-bae85a78e7db service nova] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:55:27.910312 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 621/1239] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:55:27 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:55:35.838684 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbfd59d-bdbf-4f29-8fc1-1961eea3af74 service neutron] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:55:35.847216 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbfd59d-bdbf-4f29-8fc1-1961eea3af74 service neutron] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:55:35.850942 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21464417-ef8b-46ea-b1c6-c87ac8a81d72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3491680e892041678242f9b93617b9a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:55:35.851573 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21464417-ef8b-46ea-b1c6-c87ac8a81d72 service neutron] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:55:35.851862 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21464417-ef8b-46ea-b1c6-c87ac8a81d72 service neutron] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:55:35.852142 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21464417-ef8b-46ea-b1c6-c87ac8a81d72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:55:35.910772 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21464417-ef8b-46ea-b1c6-c87ac8a81d72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:55:35.912215 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21464417-ef8b-46ea-b1c6-c87ac8a81d72 service neutron] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:55:35.931310 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 619/1240] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:55:35 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:55:37.894908 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=6 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:55:39.465659 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5659e891-6597-4fc1-9560-8530ab3b2536 None None] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:55:39.466289 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5659e891-6597-4fc1-9560-8530ab3b2536 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:55:39.466362 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5659e891-6597-4fc1-9560-8530ab3b2536 None None] PATH_INFO: `/` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:55:39.468472 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 622/1241] 10.222.0.16 () {54 vars in 921 bytes} [Fri Jul 15 20:55:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:55:39.483824 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27207da0-f72b-4817-8b3b-8f8e20d5036c None None] REQUEST_METHOD: `POST` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:55:39.484694 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27207da0-f72b-4817-8b3b-8f8e20d5036c None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:55:39.485254 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27207da0-f72b-4817-8b3b-8f8e20d5036c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:55:39.556270 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.auth.core [None req-27207da0-f72b-4817-8b3b-8f8e20d5036c None None] MFA Rules not processed for user `913ad55c6c7b4c41ac22dd0a93ef656c`. Rule list: `[]` (Enabled: `True`). {{(pid=98952) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:55:39.558824 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-27207da0-f72b-4817-8b3b-8f8e20d5036c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:55:39.568268 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 620/1242] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Jul 15 20:55:39 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:55:39.579519 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5659e891-6597-4fc1-9560-8530ab3b2536 None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:55:39.593965 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5659e891-6597-4fc1-9560-8530ab3b2536 None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:55:39.598964 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bec2ab1-f101-47f1-9fb1-49512e457926 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913ad55c6c7b4c41ac22dd0a93ef656c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:55:39.599886 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec2ab1-f101-47f1-9fb1-49512e457926 service placement] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:55:39.600067 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec2ab1-f101-47f1-9fb1-49512e457926 service placement] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:55:39.600346 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec2ab1-f101-47f1-9fb1-49512e457926 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:55:39.609826 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bec2ab1-f101-47f1-9fb1-49512e457926 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:55:39.611432 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bec2ab1-f101-47f1-9fb1-49512e457926 service placement] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:55:39.622635 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 623/1243] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:55:39 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:55:42.667736 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c998961b-d679-4ba5-99da-fea0d78719a9 None None] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:55:42.668338 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c998961b-d679-4ba5-99da-fea0d78719a9 None None] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:55:42.668338 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c998961b-d679-4ba5-99da-fea0d78719a9 None None] PATH_INFO: `/` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:55:42.669695 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 621/1244] 10.222.0.16 () {54 vars in 921 bytes} [Fri Jul 15 20:55:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:55:42.679942 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545fa016-42f2-4a0b-aefd-7ea9d20bcc3e None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:55:42.680427 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545fa016-42f2-4a0b-aefd-7ea9d20bcc3e None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:55:42.680529 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545fa016-42f2-4a0b-aefd-7ea9d20bcc3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:55:42.697909 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-545fa016-42f2-4a0b-aefd-7ea9d20bcc3e None None] MFA Rules not processed for user `913ad55c6c7b4c41ac22dd0a93ef656c`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:55:42.699655 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-545fa016-42f2-4a0b-aefd-7ea9d20bcc3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:55:42.713807 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 624/1245] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Jul 15 20:55:42 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 20:55:42.724894 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c998961b-d679-4ba5-99da-fea0d78719a9 None None] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:55:42.740236 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c998961b-d679-4ba5-99da-fea0d78719a9 None None] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:55:42.750150 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df693f5a-fa99-4f8b-a3ad-92939312e75a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913ad55c6c7b4c41ac22dd0a93ef656c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:55:42.750502 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545fa016-42f2-4a0b-aefd-7ea9d20bcc3e None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:55:42.750823 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df693f5a-fa99-4f8b-a3ad-92939312e75a service placement] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:55:42.751285 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df693f5a-fa99-4f8b-a3ad-92939312e75a service placement] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:55:42.751612 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df693f5a-fa99-4f8b-a3ad-92939312e75a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:55:42.763227 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df693f5a-fa99-4f8b-a3ad-92939312e75a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:55:42.764106 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545fa016-42f2-4a0b-aefd-7ea9d20bcc3e None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:55:42.764846 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df693f5a-fa99-4f8b-a3ad-92939312e75a service placement] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:55:42.769500 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcabd38-9597-47a0-93e7-4dd018537c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5e0cb75b5f34491a7e94518c7bcdb03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:55:42.770498 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcabd38-9597-47a0-93e7-4dd018537c33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:55:42.770846 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcabd38-9597-47a0-93e7-4dd018537c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:55:42.771906 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcabd38-9597-47a0-93e7-4dd018537c33 admin admin] PATH_INFO: `/v3/users/f7dea4f74fa9403aba00ece617f77b89` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:55:42.772486 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcabd38-9597-47a0-93e7-4dd018537c33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7dea4f74fa9403aba00ece617f77b89)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:55:42.774646 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcabd38-9597-47a0-93e7-4dd018537c33 admin admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:55:42.778797 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 622/1246] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:55:42 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:55:42.828697 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.notifications [None req-2bcabd38-9597-47a0-93e7-4dd018537c33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7dea4f74fa9403aba00ece617f77b89'} {{(pid=98951) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:55:42.829386 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.notifications [None req-2bcabd38-9597-47a0-93e7-4dd018537c33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7dea4f74fa9403aba00ece617f77b89'} {{(pid=98951) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:55:42.836084 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.notifications [None req-2bcabd38-9597-47a0-93e7-4dd018537c33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7dea4f74fa9403aba00ece617f77b89'} {{(pid=98951) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:55:42.848582 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.notifications [None req-2bcabd38-9597-47a0-93e7-4dd018537c33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7dea4f74fa9403aba00ece617f77b89'} {{(pid=98951) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:55:42.855379 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.notifications [None req-2bcabd38-9597-47a0-93e7-4dd018537c33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7dea4f74fa9403aba00ece617f77b89'} {{(pid=98951) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:55:42.861185 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 625/1247] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jul 15 20:55:42 2022] DELETE /identity/v3/users/f7dea4f74fa9403aba00ece617f77b89 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 20:55:43.036591 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df693f5a-fa99-4f8b-a3ad-92939312e75a service placement] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:55:43.048279 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df693f5a-fa99-4f8b-a3ad-92939312e75a service placement] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:55:43.108322 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc4fb1c-e291-4eec-b2fe-7b706265e5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5e0cb75b5f34491a7e94518c7bcdb03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:55:43.109264 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc4fb1c-e291-4eec-b2fe-7b706265e5e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:55:43.109550 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc4fb1c-e291-4eec-b2fe-7b706265e5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:55:43.109829 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc4fb1c-e291-4eec-b2fe-7b706265e5e3 admin admin] PATH_INFO: `/v3/projects/2de76c10093c41f69722889b0398d14b` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:55:43.111040 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc4fb1c-e291-4eec-b2fe-7b706265e5e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2de76c10093c41f69722889b0398d14b)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:55:43.112928 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc4fb1c-e291-4eec-b2fe-7b706265e5e3 admin admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:55:43.157452 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:55:43.161252 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.notifications [None req-6fc4fb1c-e291-4eec-b2fe-7b706265e5e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2de76c10093c41f69722889b0398d14b', 'request_id': 'req-6fc4fb1c-e291-4eec-b2fe-7b706265e5e3'} {{(pid=98952) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:55:43.167361 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.notifications [None req-6fc4fb1c-e291-4eec-b2fe-7b706265e5e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2de76c10093c41f69722889b0398d14b', 'request_id': 'req-6fc4fb1c-e291-4eec-b2fe-7b706265e5e3'} {{(pid=98952) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:55:43.175014 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.notifications [None req-6fc4fb1c-e291-4eec-b2fe-7b706265e5e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2de76c10093c41f69722889b0398d14b', 'request_id': 'req-6fc4fb1c-e291-4eec-b2fe-7b706265e5e3'} {{(pid=98952) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:55:43.186434 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.notifications [None req-6fc4fb1c-e291-4eec-b2fe-7b706265e5e3 admin admin] The token cache is being invalidate because project 2de76c10093c41f69722889b0398d14b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98952) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:55:43.186722 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.notifications [None req-6fc4fb1c-e291-4eec-b2fe-7b706265e5e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98952) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:55:43.187370 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.notifications [None req-6fc4fb1c-e291-4eec-b2fe-7b706265e5e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98952) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:55:43.188910 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 623/1248] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jul 15 20:55:43 2022] DELETE /identity/v3/projects/2de76c10093c41f69722889b0398d14b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:55:43.192921 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcabd38-9597-47a0-93e7-4dd018537c33 admin admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:55:43.194360 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-2bcabd38-9597-47a0-93e7-4dd018537c33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:55:43.208091 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcabd38-9597-47a0-93e7-4dd018537c33 admin admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:55:43.270623 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dcb824-d9f0-4dac-9a91-d0143bd73d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5e0cb75b5f34491a7e94518c7bcdb03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:55:43.271498 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dcb824-d9f0-4dac-9a91-d0143bd73d9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:55:43.271802 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dcb824-d9f0-4dac-9a91-d0143bd73d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:55:43.272062 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dcb824-d9f0-4dac-9a91-d0143bd73d9b admin admin] PATH_INFO: `/v3/users/f5501ab17eaf41b4ba611499953033b5` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:55:43.273243 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dcb824-d9f0-4dac-9a91-d0143bd73d9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5501ab17eaf41b4ba611499953033b5)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:55:43.275222 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dcb824-d9f0-4dac-9a91-d0143bd73d9b admin admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:55:43.321486 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.notifications [None req-26dcb824-d9f0-4dac-9a91-d0143bd73d9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5501ab17eaf41b4ba611499953033b5'} {{(pid=98951) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:55:43.322254 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.notifications [None req-26dcb824-d9f0-4dac-9a91-d0143bd73d9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5501ab17eaf41b4ba611499953033b5'} {{(pid=98951) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:55:43.329673 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.notifications [None req-26dcb824-d9f0-4dac-9a91-d0143bd73d9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5501ab17eaf41b4ba611499953033b5'} {{(pid=98951) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:55:43.330899 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:55:43.343704 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.notifications [None req-26dcb824-d9f0-4dac-9a91-d0143bd73d9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5501ab17eaf41b4ba611499953033b5'} {{(pid=98951) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:55:43.350675 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.notifications [None req-26dcb824-d9f0-4dac-9a91-d0143bd73d9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5501ab17eaf41b4ba611499953033b5'} {{(pid=98951) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:55:43.356918 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 626/1249] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jul 15 20:55:43 2022] DELETE /identity/v3/users/f5501ab17eaf41b4ba611499953033b5 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:55:43.543433 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc4fb1c-e291-4eec-b2fe-7b706265e5e3 admin admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:55:43.545103 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-6fc4fb1c-e291-4eec-b2fe-7b706265e5e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:55:43.560454 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc4fb1c-e291-4eec-b2fe-7b706265e5e3 admin admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:55:43.622268 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8abf09-0b61-419a-b1a6-870166c51247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5e0cb75b5f34491a7e94518c7bcdb03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:55:43.623160 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8abf09-0b61-419a-b1a6-870166c51247 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:55:43.623449 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8abf09-0b61-419a-b1a6-870166c51247 admin admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:55:43.623756 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8abf09-0b61-419a-b1a6-870166c51247 admin admin] PATH_INFO: `/v3/projects/59660395860545f8a06f32256f6a0440` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:55:43.624936 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8abf09-0b61-419a-b1a6-870166c51247 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59660395860545f8a06f32256f6a0440)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:55:43.626933 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8abf09-0b61-419a-b1a6-870166c51247 admin admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:55:43.673518 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.notifications [None req-db8abf09-0b61-419a-b1a6-870166c51247 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59660395860545f8a06f32256f6a0440', 'request_id': 'req-db8abf09-0b61-419a-b1a6-870166c51247'} {{(pid=98952) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:55:43.679023 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.notifications [None req-db8abf09-0b61-419a-b1a6-870166c51247 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59660395860545f8a06f32256f6a0440', 'request_id': 'req-db8abf09-0b61-419a-b1a6-870166c51247'} {{(pid=98952) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:55:43.685923 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.notifications [None req-db8abf09-0b61-419a-b1a6-870166c51247 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59660395860545f8a06f32256f6a0440', 'request_id': 'req-db8abf09-0b61-419a-b1a6-870166c51247'} {{(pid=98952) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:55:43.696749 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.notifications [None req-db8abf09-0b61-419a-b1a6-870166c51247 admin admin] The token cache is being invalidate because project 59660395860545f8a06f32256f6a0440 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98952) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:55:43.697043 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.notifications [None req-db8abf09-0b61-419a-b1a6-870166c51247 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98952) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:55:43.697697 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.notifications [None req-db8abf09-0b61-419a-b1a6-870166c51247 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98952) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:55:43.699279 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 624/1250] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jul 15 20:55:43 2022] DELETE /identity/v3/projects/59660395860545f8a06f32256f6a0440 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:55:53.353049 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=11,keystone:DELETE=2 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:55:53.693829 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=59,keystone:DELETE=11,keystone:INSERT=2 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:56:05.113168 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463587f7-2ce5-4c9a-ad04-6d243e6c4975 None None] REQUEST_METHOD: `POST` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:56:05.113670 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463587f7-2ce5-4c9a-ad04-6d243e6c4975 None None] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:56:05.113856 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463587f7-2ce5-4c9a-ad04-6d243e6c4975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:56:05.131839 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.auth.core [None req-463587f7-2ce5-4c9a-ad04-6d243e6c4975 None None] MFA Rules not processed for user `a9778171a01b491b800c5fe175f27086`. Rule list: `[]` (Enabled: `True`). {{(pid=98951) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:56:05.133031 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-463587f7-2ce5-4c9a-ad04-6d243e6c4975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:56:05.187267 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 627/1251] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jul 15 20:56:05 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:56:05.509584 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8abf09-0b61-419a-b1a6-870166c51247 admin admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:56:05.511122 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-db8abf09-0b61-419a-b1a6-870166c51247 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:56:05.571209 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8abf09-0b61-419a-b1a6-870166c51247 admin admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:56:05.575282 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c8422d-49ee-4b66-bf1d-22eb5f835c30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3491680e892041678242f9b93617b9a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:56:05.575939 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c8422d-49ee-4b66-bf1d-22eb5f835c30 service neutron] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:56:05.576227 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c8422d-49ee-4b66-bf1d-22eb5f835c30 service neutron] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:56:05.576508 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c8422d-49ee-4b66-bf1d-22eb5f835c30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:56:05.578558 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-f1c8422d-49ee-4b66-bf1d-22eb5f835c30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:56:05.587700 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c8422d-49ee-4b66-bf1d-22eb5f835c30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:56:05.589126 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c8422d-49ee-4b66-bf1d-22eb5f835c30 service neutron] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:56:05.597027 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 625/1252] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:56:05 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:56:06.038849 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463587f7-2ce5-4c9a-ad04-6d243e6c4975 None None] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:56:06.040881 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-463587f7-2ce5-4c9a-ad04-6d243e6c4975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:56:06.125078 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463587f7-2ce5-4c9a-ad04-6d243e6c4975 None None] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:56:06.134811 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36dd78c-0876-4958-8cf5-3b94accc0d3d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913ad55c6c7b4c41ac22dd0a93ef656c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:56:06.135546 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36dd78c-0876-4958-8cf5-3b94accc0d3d service placement] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:56:06.135837 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36dd78c-0876-4958-8cf5-3b94accc0d3d service placement] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:56:06.136114 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36dd78c-0876-4958-8cf5-3b94accc0d3d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:56:06.138002 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-c36dd78c-0876-4958-8cf5-3b94accc0d3d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:56:06.150351 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36dd78c-0876-4958-8cf5-3b94accc0d3d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:56:06.152520 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36dd78c-0876-4958-8cf5-3b94accc0d3d service placement] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:56:06.163167 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 628/1253] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:56:06 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:56:14.274178 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c8422d-49ee-4b66-bf1d-22eb5f835c30 service neutron] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:56:14.275664 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-f1c8422d-49ee-4b66-bf1d-22eb5f835c30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:56:14.348449 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c8422d-49ee-4b66-bf1d-22eb5f835c30 service neutron] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:56:14.353401 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c23355a-dbe0-4148-b4e7-1a1c9ebb63b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e5296637584004b1888453ab9056c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:56:14.354042 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c23355a-dbe0-4148-b4e7-1a1c9ebb63b0 service nova] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:56:14.354357 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c23355a-dbe0-4148-b4e7-1a1c9ebb63b0 service nova] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:56:14.354634 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c23355a-dbe0-4148-b4e7-1a1c9ebb63b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:56:14.356424 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-9c23355a-dbe0-4148-b4e7-1a1c9ebb63b0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:56:14.367894 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c23355a-dbe0-4148-b4e7-1a1c9ebb63b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:56:14.369423 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c23355a-dbe0-4148-b4e7-1a1c9ebb63b0 service nova] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:56:14.379416 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 626/1254] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:56:14 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:56:16.158952 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=57 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:56:24.375561 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=58 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:58:06.598503 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36dd78c-0876-4958-8cf5-3b94accc0d3d service placement] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:58:06.599922 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-c36dd78c-0876-4958-8cf5-3b94accc0d3d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:58:06.661509 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36dd78c-0876-4958-8cf5-3b94accc0d3d service placement] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:58:06.666577 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfa816d-0d5e-4465-87a7-632a7e5818de service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913ad55c6c7b4c41ac22dd0a93ef656c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:58:06.667218 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfa816d-0d5e-4465-87a7-632a7e5818de service placement] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:58:06.667507 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfa816d-0d5e-4465-87a7-632a7e5818de service placement] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:58:06.667789 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfa816d-0d5e-4465-87a7-632a7e5818de service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:58:06.669551 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-7bfa816d-0d5e-4465-87a7-632a7e5818de service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:58:06.680694 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfa816d-0d5e-4465-87a7-632a7e5818de service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:58:06.682336 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfa816d-0d5e-4465-87a7-632a7e5818de service placement] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:58:06.691793 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 629/1255] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:58:06 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:58:16.687864 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=28 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:58:50.156671 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c23355a-dbe0-4148-b4e7-1a1c9ebb63b0 service nova] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:58:50.158131 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-9c23355a-dbe0-4148-b4e7-1a1c9ebb63b0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:58:50.204715 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c23355a-dbe0-4148-b4e7-1a1c9ebb63b0 service nova] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:58:50.208864 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b567c26e-c769-4385-a64f-f4188e16beaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3491680e892041678242f9b93617b9a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:58:50.209511 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b567c26e-c769-4385-a64f-f4188e16beaa service neutron] REQUEST_METHOD: `GET` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:58:50.209806 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b567c26e-c769-4385-a64f-f4188e16beaa service neutron] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:58:50.210103 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b567c26e-c769-4385-a64f-f4188e16beaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:58:50.211889 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-b567c26e-c769-4385-a64f-f4188e16beaa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:58:50.298872 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b567c26e-c769-4385-a64f-f4188e16beaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:58:50.300264 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b567c26e-c769-4385-a64f-f4188e16beaa service neutron] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:58:50.309519 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 627/1256] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 20:58:50 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:58:56.635150 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfa816d-0d5e-4465-87a7-632a7e5818de service placement] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:58:56.636592 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-7bfa816d-0d5e-4465-87a7-632a7e5818de service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:58:56.650185 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfa816d-0d5e-4465-87a7-632a7e5818de service placement] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:58:56.654657 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28d0988-8b2a-416b-9cdb-3c399a7a1ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5e0cb75b5f34491a7e94518c7bcdb03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:58:56.655528 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d0988-8b2a-416b-9cdb-3c399a7a1ee5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:58:56.655810 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d0988-8b2a-416b-9cdb-3c399a7a1ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:58:56.656086 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d0988-8b2a-416b-9cdb-3c399a7a1ee5 admin admin] PATH_INFO: `/v3/users/a9778171a01b491b800c5fe175f27086` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:58:56.671223 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28d0988-8b2a-416b-9cdb-3c399a7a1ee5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9778171a01b491b800c5fe175f27086)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:58:56.673160 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28d0988-8b2a-416b-9cdb-3c399a7a1ee5 admin admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:58:56.721864 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.notifications [None req-d28d0988-8b2a-416b-9cdb-3c399a7a1ee5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9778171a01b491b800c5fe175f27086'} {{(pid=98951) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:58:56.723105 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.notifications [None req-d28d0988-8b2a-416b-9cdb-3c399a7a1ee5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9778171a01b491b800c5fe175f27086'} {{(pid=98951) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:58:56.730885 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.notifications [None req-d28d0988-8b2a-416b-9cdb-3c399a7a1ee5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9778171a01b491b800c5fe175f27086'} {{(pid=98951) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:58:56.743761 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.notifications [None req-d28d0988-8b2a-416b-9cdb-3c399a7a1ee5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9778171a01b491b800c5fe175f27086'} {{(pid=98951) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:58:56.750535 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.notifications [None req-d28d0988-8b2a-416b-9cdb-3c399a7a1ee5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9778171a01b491b800c5fe175f27086'} {{(pid=98951) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:58:56.756410 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 630/1257] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jul 15 20:58:56 2022] DELETE /identity/v3/users/a9778171a01b491b800c5fe175f27086 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:58:56.929656 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b567c26e-c769-4385-a64f-f4188e16beaa service neutron] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:58:56.942454 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b567c26e-c769-4385-a64f-f4188e16beaa service neutron] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:58:56.999418 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d6252-8ac0-48a1-ba09-586a5a95f3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5e0cb75b5f34491a7e94518c7bcdb03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:58:57.000306 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d6252-8ac0-48a1-ba09-586a5a95f3f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:58:57.000591 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d6252-8ac0-48a1-ba09-586a5a95f3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:58:57.000866 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d6252-8ac0-48a1-ba09-586a5a95f3f4 admin admin] PATH_INFO: `/v3/projects/9023965425c74a78bc31f8b2eeef9d81` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:58:57.011146 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85d6252-8ac0-48a1-ba09-586a5a95f3f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9023965425c74a78bc31f8b2eeef9d81)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:58:57.013056 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85d6252-8ac0-48a1-ba09-586a5a95f3f4 admin admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:58:57.051592 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:58:57.059397 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.notifications [None req-a85d6252-8ac0-48a1-ba09-586a5a95f3f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9023965425c74a78bc31f8b2eeef9d81', 'request_id': 'req-a85d6252-8ac0-48a1-ba09-586a5a95f3f4'} {{(pid=98952) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:58:57.064813 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.notifications [None req-a85d6252-8ac0-48a1-ba09-586a5a95f3f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9023965425c74a78bc31f8b2eeef9d81', 'request_id': 'req-a85d6252-8ac0-48a1-ba09-586a5a95f3f4'} {{(pid=98952) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:58:57.071601 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.notifications [None req-a85d6252-8ac0-48a1-ba09-586a5a95f3f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9023965425c74a78bc31f8b2eeef9d81', 'request_id': 'req-a85d6252-8ac0-48a1-ba09-586a5a95f3f4'} {{(pid=98952) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:58:57.083511 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.notifications [None req-a85d6252-8ac0-48a1-ba09-586a5a95f3f4 admin admin] The token cache is being invalidate because project 9023965425c74a78bc31f8b2eeef9d81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98952) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:58:57.083799 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.notifications [None req-a85d6252-8ac0-48a1-ba09-586a5a95f3f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98952) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:58:57.084424 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.notifications [None req-a85d6252-8ac0-48a1-ba09-586a5a95f3f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98952) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:58:57.085963 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 628/1258] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jul 15 20:58:56 2022] DELETE /identity/v3/projects/9023965425c74a78bc31f8b2eeef9d81 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 20:58:57.090036 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28d0988-8b2a-416b-9cdb-3c399a7a1ee5 admin admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:58:57.091458 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-d28d0988-8b2a-416b-9cdb-3c399a7a1ee5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:58:57.104759 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28d0988-8b2a-416b-9cdb-3c399a7a1ee5 admin admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:58:57.159364 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43aa7ca-ed7b-419d-a70b-dfaf34c5b8da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5e0cb75b5f34491a7e94518c7bcdb03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:58:57.160851 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43aa7ca-ed7b-419d-a70b-dfaf34c5b8da admin admin] REQUEST_METHOD: `DELETE` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:58:57.161140 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43aa7ca-ed7b-419d-a70b-dfaf34c5b8da admin admin] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:58:57.161422 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43aa7ca-ed7b-419d-a70b-dfaf34c5b8da admin admin] PATH_INFO: `/v3/users/886ca46645bf4da1bfb68c8bf77f89e6` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:58:57.174591 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43aa7ca-ed7b-419d-a70b-dfaf34c5b8da admin admin] RBAC: Authorizing `identity:delete_user(user_id=886ca46645bf4da1bfb68c8bf77f89e6)` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:58:57.176573 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43aa7ca-ed7b-419d-a70b-dfaf34c5b8da admin admin] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:58:57.223471 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.notifications [None req-c43aa7ca-ed7b-419d-a70b-dfaf34c5b8da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '886ca46645bf4da1bfb68c8bf77f89e6'} {{(pid=98951) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:58:57.224134 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.notifications [None req-c43aa7ca-ed7b-419d-a70b-dfaf34c5b8da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '886ca46645bf4da1bfb68c8bf77f89e6'} {{(pid=98951) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:58:57.227790 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:58:57.231817 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.notifications [None req-c43aa7ca-ed7b-419d-a70b-dfaf34c5b8da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '886ca46645bf4da1bfb68c8bf77f89e6'} {{(pid=98951) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:58:57.245063 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.notifications [None req-c43aa7ca-ed7b-419d-a70b-dfaf34c5b8da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '886ca46645bf4da1bfb68c8bf77f89e6'} {{(pid=98951) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:58:57.251801 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.notifications [None req-c43aa7ca-ed7b-419d-a70b-dfaf34c5b8da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '886ca46645bf4da1bfb68c8bf77f89e6'} {{(pid=98951) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:58:57.258249 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 631/1259] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jul 15 20:58:57 2022] DELETE /identity/v3/users/886ca46645bf4da1bfb68c8bf77f89e6 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:58:57.428730 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d6252-8ac0-48a1-ba09-586a5a95f3f4 admin admin] Authenticating user token {{(pid=98952) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:58:57.430401 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.fernet_utils [None req-a85d6252-8ac0-48a1-ba09-586a5a95f3f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98952) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:58:57.444765 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d6252-8ac0-48a1-ba09-586a5a95f3f4 admin admin] Validating token access rules against request {{(pid=98952) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:58:57.504541 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a99750-7c92-4fde-bcf3-8821ff134904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904f3e39010c4ee1ad10cdd271b0b153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5e0cb75b5f34491a7e94518c7bcdb03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:58:57.505413 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a99750-7c92-4fde-bcf3-8821ff134904 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:58:57.505691 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a99750-7c92-4fde-bcf3-8821ff134904 admin admin] SCRIPT_NAME: `/identity` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:58:57.505963 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a99750-7c92-4fde-bcf3-8821ff134904 admin admin] PATH_INFO: `/v3/projects/d63ba6eb7dab46a3bbac9d309927d073` {{(pid=98952) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:58:57.517116 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a99750-7c92-4fde-bcf3-8821ff134904 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d63ba6eb7dab46a3bbac9d309927d073)` {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:58:57.519096 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a99750-7c92-4fde-bcf3-8821ff134904 admin admin] RBAC: Authorization granted {{(pid=98952) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:58:57.569552 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.notifications [None req-a8a99750-7c92-4fde-bcf3-8821ff134904 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd63ba6eb7dab46a3bbac9d309927d073', 'request_id': 'req-a8a99750-7c92-4fde-bcf3-8821ff134904'} {{(pid=98952) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:58:57.575304 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.notifications [None req-a8a99750-7c92-4fde-bcf3-8821ff134904 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd63ba6eb7dab46a3bbac9d309927d073', 'request_id': 'req-a8a99750-7c92-4fde-bcf3-8821ff134904'} {{(pid=98952) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:58:57.584660 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.notifications [None req-a8a99750-7c92-4fde-bcf3-8821ff134904 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd63ba6eb7dab46a3bbac9d309927d073', 'request_id': 'req-a8a99750-7c92-4fde-bcf3-8821ff134904'} {{(pid=98952) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:58:57.598486 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.notifications [None req-a8a99750-7c92-4fde-bcf3-8821ff134904 admin admin] The token cache is being invalidate because project d63ba6eb7dab46a3bbac9d309927d073 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98952) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:58:57.598840 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.notifications [None req-a8a99750-7c92-4fde-bcf3-8821ff134904 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98952) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:58:57.599486 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG keystone.notifications [None req-a8a99750-7c92-4fde-bcf3-8821ff134904 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98952) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:58:57.601078 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: [pid: 98952|app: 0|req: 629/1260] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jul 15 20:58:57 2022] DELETE /identity/v3/projects/d63ba6eb7dab46a3bbac9d309927d073 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 20:59:07.254244 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG dbcounter [-] [98951] Writing DB stats keystone:SELECT=12,keystone:DELETE=2 {{(pid=98951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:59:07.594957 dv-osbrick-836059-7-ceph devstack@keystone.service[98952]: DEBUG dbcounter [-] [98952] Writing DB stats keystone:SELECT=65,keystone:DELETE=11,keystone:INSERT=2 {{(pid=98952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 21:03:10.545463 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43aa7ca-ed7b-419d-a70b-dfaf34c5b8da admin admin] Authenticating user token {{(pid=98951) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 21:03:10.546946 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-c43aa7ca-ed7b-419d-a70b-dfaf34c5b8da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:03:10.624308 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43aa7ca-ed7b-419d-a70b-dfaf34c5b8da admin admin] Validating token access rules against request {{(pid=98951) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 21:03:10.690600 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c1640-a6e6-4f9c-9c7e-6db9fcf9b531 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913ad55c6c7b4c41ac22dd0a93ef656c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ea017caabac4346a1fc822ddfe3e8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 21:03:10.691253 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c1640-a6e6-4f9c-9c7e-6db9fcf9b531 service placement] REQUEST_METHOD: `GET` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 21:03:10.691541 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c1640-a6e6-4f9c-9c7e-6db9fcf9b531 service placement] SCRIPT_NAME: `/identity` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 21:03:10.691823 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c1640-a6e6-4f9c-9c7e-6db9fcf9b531 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98951) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 21:03:10.693649 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.fernet_utils [None req-1c5c1640-a6e6-4f9c-9c7e-6db9fcf9b531 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98951) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 21:03:10.704460 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5c1640-a6e6-4f9c-9c7e-6db9fcf9b531 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 21:03:10.706034 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5c1640-a6e6-4f9c-9c7e-6db9fcf9b531 service placement] RBAC: Authorization granted {{(pid=98951) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 21:03:10.716366 dv-osbrick-836059-7-ceph devstack@keystone.service[98951]: [pid: 98951|app: 0|req: 632/1261] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jul 15 21:03:10 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)